Is there a way to remove a word from a KeyedVectors vocab?

Question

I need to remove an invalid word from the vocab of a "gensim.models.keyedvectors.Word2VecKeyedVectors".

I tried to remove it using del model.vocab[word], if I print the model.vocab the word disappeared, but when I run model.most_similar using other words the word that I deleted is still appearing as similar. So how can I delete a word from model.vocab in a way that affect the model.most_similar to not bring it?

Possible duplicate of [How to remove a word completely from a Word2Vec model in gensim?](https://stackoverflow.com/questions/48941648/how-to-remove-a-word-completely-from-a-word2vec-model-in-gensim) — Shern, Apr 17 '19 at 04:37

score 2 · Accepted Answer · answered Feb 15 '19 at 18:43

There's no existing method supporting the removal of individual words.

A quick-and-dirty workaround might be to, at the same time as removing the vocab entry, noting the index of the existing vector (in the underlying large vector array), and also changing the string in the kv_model.index2entity list at that index to some plug value (like say, '***DELETED***').

Then, after performing any most_similar(), discard any entries matching '***DELETED***'.

Ok, got it! Thanks! – Matheus Tramontini Feb 18 '19 at 14:34 — Matheus Tramontini, Feb 18 '19 at 14:34

Shern · Answer 2 · 2019-04-18T07:55:12.040

0

Refer to:

How to remove a word completely from a Word2Vec model in gensim?

Possible method 1: I solve it by editing the text model file itself.
Possible method 2: Refer to @zsozso's answer. (Though I didn't get it to

work).

edited Apr 18 '19 at 07:55

answered Apr 17 '19 at 02:43

Shern

712
1
8
20

Is there a way to remove a word from a KeyedVectors vocab?

2 Answers2