Rollback an apt-get upgrade if something goes wrong on Debian / Ubuntu Linux

Explain how to undo or rollback an apt-get install command on a Debian or Ubuntu or Mint Linux.

Source: Rollback an apt-get upgrade if something goes wrong on Debian / Ubuntu Linux (nixCraft)