In Linux, we can use the uniq command that comes in handy when we want to list or remove duplicate lines that present adjacently in a file.

Source: Uniq Command – Remove Duplicate Lines from a Linux Files (TecMint)