1

I'm trying to use Awk to compare the content of two large CSV files (more than 5000 rows each) but I can't get what I want.

Here is my problem:

I have a first file (File1) with a list of names ($1) and cities ($2) whose structure looks like this:

john;london
marc;paris
karen;new york
ben;london
vic;dublin

I have a second file (File2) with other information where we find some names ($3) of File1:

45456;windows;john;454646
47764;mac;zack;470093
41225;mac;ben;622101
12634;windows;ben;218996
7856;windows;karen;637294
12;mac;finn;878317
2315;windows;beverly;221167
445;windows;lilly;12316
3232;mac;john;601316
4546;mac;fish;305035
487;windows;vic;447421
46464;mac;karen;468154

I would like to extract from File2 all the lines whose names appear in File1 while adding the cities associated to each name in File1. Here is an example of the result I am looking for:

45456;windows;john;454646;london
3232;mac;john;601316;london
7856;windows;karen;637294;new york
46464;mac;karen;468154;new york
41225;mac;ben;622101;london
12634;windows;ben;218996;london
487;windows;vic;447421;dublin

Could you help me?

Cyrus
  • 84,225
  • 14
  • 89
  • 153
Nildran
  • 13
  • 3
  • Does is have to be awk? If not, I'd recommend checking out [this](https://stackoverflow.com/questions/61784456/combine-two-csv-files-based-on-common-column-using-awk-or-sed) or [this](https://stackoverflow.com/questions/5467690/how-to-merge-two-files-using-awk). – alagner Nov 25 '21 at 20:22
  • Please add to your question (no comment): What have you searched for, and what did you find? What have you tried, and how did it fail? – Cyrus Nov 25 '21 at 23:43

3 Answers3

3

Build an associative array of the first file, making the name the index and the city the value. For the second file check if the name features in the aray, if yes, print the line and attach the city.

awk -F';' 'NR==FNR{a[$1]=$2}$3 in a{print $0";"a[$3]}' File1 File2
45456;windows;john;454646;london
41225;mac;ben;622101;london
12634;windows;ben;218996;london
7856;windows;karen;637294;new york
3232;mac;john;601316;london
487;windows;vic;447421;dublin
46464;mac;karen;468154;new york
tink
  • 14,342
  • 4
  • 46
  • 50
1

With bash, GNU sort and GNU join:

join -t ';' -1 1 -2 3 <(sort File1) <(sort -t ';' -k 3 File2) -o 2.1,2.2,1.1,2.4,1.2

Output:

12634;windows;ben;218996;london
41225;mac;ben;622101;london
45456;windows;john;454646;london
3232;mac;john;601316;london
46464;mac;karen;468154;new york
7856;windows;karen;637294;new york
487;windows;vic;447421;dublin
Cyrus
  • 84,225
  • 14
  • 89
  • 153
0

Using 

csvjoin -d ';' -H -c 3,1 File2 File1 | csvformat -D ';' | tail -n +2
glenn jackman
  • 238,783
  • 38
  • 220
  • 352