I have a file say test.txt and it has text entries like
"134
212
278
299
299
300
300
301"

Now I want to delete anything that repeats more than once, hence deleting one entry of 299 and one entry of 300. Since it's dynamic (I wouldn't know what to look for if I were to do a search using regular expression). How can I achieve this using sed or awk?

Thanks for any help you can provide.

Hi,

Please test with cat test.txt|sort -u o cat test.txt|uniq

Gustavo.

cat test.txt|sort -u | cat test.txt|uniq
or simply using the uniq command works.

thanks Gustavo!