runiq

An efficient way to filter duplicate lines from input, à la uniq