Remove duplicate lines from text while optionally preserving the original order. Identify and count duplicate entries. Clean up data lists and remove redundancy.