Swapping of columns in a file and remove duplicates

Posted by LucaB on Stack Overflow See other posts from Stack Overflow or by LucaB
Published on 2010-04-12T19:38:22Z Indexed on 2010/04/12 19:43 UTC
Read the original article Hit count: 288

Filed under:
|
|

Hi all i have a file like this:

term1 term2
term3 term4
term2 term1
term5 term3
..... .....

what i need to do is to remove duplicates in any order they appear, such as:

term1 term2

and

term2 term1

is a duplicate to me. It is a really long file, so I'm not sure what can be faster. Does anyone has an idea on how to do this? awk perhaps?

© Stack Overflow or respective owner

Related posts about awk

Related posts about linux