How to remove dictionary from list of dictionary if value repeats in items

Question

List of dictionary is below

l = [
{'firstname': 'joe', 'surname': 'ABCD', 'tile' : 'DE'},
{'firstname': 'john', 'surname': 'DEF', 'tile' : 'BC'},
{'firstname': 'joe', 'surname': 'bloggs', 'tile' : 'DE'},
{'firstname': 'jane', 'surname': 'HH', 'tile' : 'AD'}
]

Need to delete item from l if firstname and tile matches

pseudo code

for i in l:
   if i['firstname'] + i['tile'] in l:
        l.pop(i)

I have gone through python remove duplicate dictionaries from a list

its removing entire dict matches

Also gone through second answer python remove duplicate dictionaries from a list

Andrej Kesely · Accepted Answer · 2022-05-19T13:15:50.773

2

Try:

l = [
    {"firstname": "joe", "surname": "ABCD", "tile": "DE"},
    {"firstname": "john", "surname": "DEF", "tile": "BC"},
    {"firstname": "joe", "surname": "bloggs", "tile": "DE"},
    {"firstname": "jane", "surname": "HH", "tile": "AD"},
]

out = {}
for d in reversed(l):
    out[(d["firstname"], d["tile"])] = d

print(list(out.values()))

Prints:

[
    {"firstname": "jane", "surname": "HH", "tile": "AD"},
    {"firstname": "joe", "surname": "ABCD", "tile": "DE"},
    {"firstname": "john", "surname": "DEF", "tile": "BC"},
]

edited May 19 '22 at 13:15

answered May 19 '22 at 13:03

Andrej Kesely

168,389
15
48
91

why reversed, other code is also working – sim May 19 '22 at 13:07
@sim I reversed the list because I want to keep the first occurrence. If you don't need that, you can remove `reversed()` – Andrej Kesely May 19 '22 at 13:08
1

Why not just set d as the default instead? – Kelly Bundy May 19 '22 at 13:14
@KellyBundy Yup, You're right...sometimes I complicate things :) – Andrej Kesely May 19 '22 at 13:16
Actually I meant `for d in l: out.setdefault((d["firstname"], d["tile"]), d)`. But yours works, too. – Kelly Bundy May 19 '22 at 13:17
Although yours changes the order (and not just reversing it), so maybe the forwards-iteration with setdefault is preferable. – Kelly Bundy May 19 '22 at 13:21

score 1 · Answer 2 · answered May 19 '22 at 13:03

Try this,

Extended this SO answer Index of duplicates items in a python list

Code:

from collections import defaultdict

l = [
{'firstname': 'joe', 'surname': 'ABCD', 'tile' : 'DE'},
{'firstname': 'john', 'surname': 'DEF', 'tile' : 'BC'},
{'firstname': 'joe', 'surname': 'bloggs', 'tile' : 'DE'},
{'firstname': 'jane', 'surname': 'HH', 'tile' : 'AD'}
]


group = [(item['firstname'], item['tile']) for item in l]

def list_duplicates(seq):
    tally = defaultdict(list)
    for i,item in enumerate(seq):
        tally[item].append(i)
    return ((key,locs) for key,locs in tally.items() 
                            if len(locs)>=1)

new_l = []
for dup in list_duplicates(group):
    new_l.append(l[dup[1][0]])
  
new_l

Output:

[{'firstname': 'joe', 'surname': 'ABCD', 'tile': 'DE'},
 {'firstname': 'john', 'surname': 'DEF', 'tile': 'BC'},
 {'firstname': 'jane', 'surname': 'HH', 'tile': 'AD'}]

How to remove dictionary from list of dictionary if value repeats in items

2 Answers2