Find duplicates lines based on some delimited fileds on line

Posted by Oliv on Stack Overflow See other posts from Stack Overflow or by Oliv
Published on 2010-05-26T10:54:30Z Indexed on 2010/05/26 14:11 UTC
Read the original article Hit count: 203

Filed under:

fields

|

ksh

|

partial

|

lines

|

duplicate

Hello,

I have a file with lines having some fields delimited by "|".

I have to extract the lines that are identical based on some of the fileds (i.e. find lines which contain the same values for fields 1,2,3 12,and 13) Other fields contents have no importance for searching but the whole extracted lines have to be complete.

Can anyone tell me how I can do that in KSH scripting (By exemple a script with some arguments (order dependent) that define the fileds separator and the fields which have to be compared to find duplicates lines in input file )

Thanks in advance and kind regards

Oli

© Stack Overflow or respective owner

Related posts about fields

Comparing form fields with data base fields and highlighting the form fields

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, Can you help me in the following two scenarios (PHP+MYSQL) Scenario1: I need to compare the HTML Form field values with the Database field values and highlight the form fields in some color whose values are different from database values before submitting the form (to alert the user). Scenario2: On… >>> More
jQuery to populate form fields based on first entered value where number of fields is unknown

as seen on Stack Overflow - Search for 'Stack Overflow'
Greetings, I have a form with a variable number of inputs, a simplified version of which looks like this: <form> <label for="same">all the same as first?</label> <input id="same" name="same" type="checkbox" /> <input type="text" id="foo[1]" name="foo[1]" value="" /> <input… >>> More
Where is meta.local_fields set in django.db.models.base.py ?

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm getting the error: Exception Value: (1110, "Column 'about' specified twice") As I was reviewing the Django error page, I noticed that the customizations the model User, seem to be appended to the List twice. This seems to be happening here in django/db/model/base.py in base_save(): values… >>> More
Populating array of input fields as alternate fields using jQuery UI datepicker

as seen on Stack Overflow - Search for 'Stack Overflow'
I am using jquery ui datepicker in order to populate start and end dates for multiple events on the same page, the number of events is dynamic and I need to post day, month and year as separate fields, so I have something like this: <input type="text" name="event[0].startDate" class="date"/> <input… >>> More
Comparing fields of one table to other fields of another table

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello! I have a function called add_item which actually inserts values in a field item_name of temporary table called temp having fields temp_id and item_name. I have another table calleed item which consists of fields item_id, item_name, price. I have another table called quotation which consists… >>> More

Related posts about ksh

home, end, delete, pageup, pagedown with ksh

as seen on Server Fault - Search for 'Server Fault'
Hello. I want to use home, end, delete, pageup, pagedown with ksh. My TERM is xterm-color. These keys works fine with tcsh and zsh, but not with ksh (print a tilda ~) I found this: bind '^[[3'=prefix-2 bind '^[[3~'=delete-char-forward bind '^[[1'=prefix-2 bind '^[[1~'=beginning-of-line bind '^[[4'=prefix-2 bind… >>> More
ksh: assigning function output to an array

as seen on Stack Overflow - Search for 'Stack Overflow'
Why doesn't this work??? #!/bin/ksh # array testfunc() function testfunc { typeset -A env env=( one="motherload" ) print -r $env return 0 } testfunc # returns: ( one=motherload ) typeset -A testvar # segfaults on linux, memfaults on solaris testvar=$(testfunc) # segfaults… >>> More
Getting past dates in HP-UX with ksh

as seen on Stack Overflow - Search for 'Stack Overflow'
Ok, so I need to translate a script from a nice linux & bash configuration to ksh in hp-ux. Each and every command expects a different syntax and i want to kill myself. But let's skip the rant. This is part of my script anterior=`date +"%Y%0m" -d '1 month ago'` I basically need to get a past… >>> More
Converting /bin/ksh commands to their PERL equivalent, and executing

as seen on Stack Overflow - Search for 'Stack Overflow'
How do I do the following conversion within a PERL script? cd /usr/src/sys --- chdir '/usr/src/sys' execute "chdir '/usr/src/sys' " >>> More
KSH shell script won't execute and returns 127 (not found)

as seen on Stack Overflow - Search for 'Stack Overflow'
Can anyone enlighten me why the following won't work? $ groups staff btgroup $ ls -l total 64 -rw-rw---- 1 sld248 btgroup 26840 Apr 02 13:39 padaddwip.jks -rwxrwx--- 1 sld248 btgroup 1324 Apr 02 13:39 padaddwip.ksh $ ./padaddwip.ksh ksh: ./padaddwip.ksh: not found… >>> More