Find similar word for word in the list

Question

I'm trying to make filter bot that can find same characters or same words in message that's listed in block list

block = ["damn", "shit"]

if message count : daaaaammmmnnnn or sssssshit or da-mn or da.mn. like that catch it and return True

how can I do this.

thx.

possible duplicate of [How do you implement a good profanity filter?](http://stackoverflow.com/questions/273516/how-do-you-implement-a-good-profanity-filter) — ceejayoz, Feb 15 '15 at 01:28
@devo means if any list `block` element present in the message string then return True otherwise return False? — Vivek Sable, Feb 15 '15 at 01:30
@VivekSable yes and if the message contains same block list but have many characters — devo devox, Feb 15 '15 at 01:34
@VivekSable list : damn and message is : daaaaammmmnnnn - return True — devo devox, Feb 15 '15 at 01:36
@ceejayoz this url have php lang I'm talking about Python. thnx. — devo devox, Feb 15 '15 at 01:39
A better similarity metric is the [*Levenshtein distance*](http://en.wikipedia.org/wiki/Levenshtein_distance). — Willem Van Onsem, Feb 15 '15 at 01:45
@devodevox The take-away from the duplicate question is "don't bother". PHP vs. Python is irrelevant. — ceejayoz, Feb 15 '15 at 02:05
Bash and regular expressions might be a faster way --> cat txt | grep -i d+a+m+n — mac389, Feb 15 '15 at 02:05

Vivek Sable · Accepted Answer · 2015-02-15T02:34:05.067

Set flag value to True when message contains any items from the list block.

Get block list and iterate every item from the list by for loop.
Set value of flag to False by default means message not contains any block list item.
Set value of flag to True when item from the block list in the message.
Use break statement to stop for loop iteration.

e.g.

>>> block = ["damn", "shit"]
>>> msg = "test masf to check shit or damn"
>>> flag = False
>>> for i in block:
...   if i in msg:
...      flag = True
...      break
... 
>>> flag
True
>>>

Updated:

Set block list words.
Create list of list of block list word characters.
Remove punctuation from the input string.
split string to words.
split word and create sequence list of characters from the word.
check sequence list of characters present in block list character list.

code:

import string
block = ["damn", "shit"]
block_char_list = [ list(i) for i in block ]

def  getbBlockListFlag(msg):
    #Remove punctuation
    tmp = msg.translate(string.maketrans("",""), string.punctuation)
    tmp1 = []
    for word in tmp.split():
        j = []
        for k in list(word):
            if k not in j:
                j.append(k)
            elif k != j[-1]:
                j.append(k)

        # word in block list
        if j in block_char_list:
            return True, j

    return False, []



msg = "True test case ? daaaammmmnnnnn.,"
status, block_char = getbBlockListFlag(msg)
if status:  
    print "The word `%s` from block list is presnt in input '%s'"%(''.join(block_char), msg)
else:
    print "No word from block list is presnt in input '%s'"%(msg)

msg = "True test case ? normal damn.,"
status, bloak_char = getbBlockListFlag(msg)
if status:  
    print "The word `%s` from block list is presnt in input '%s'"%(''.join(block_char), msg)
else:
    print "No word from block list is presnt in input '%s'"%(msg)

msg = "False test case ? nothing when sequance aaammdddnnn.."
status, bloak_char = getbBlockListFlag(msg)
if status:  
    print "The word `%s` from block list is presnt in input '%s'"%(''.join(block_char), msg)
else:
    print "No word from block list is presnt in input '%s'"%(msg)


msg = "False test case ? nothing.."
status, bloak_char = getbBlockListFlag(msg)
if status:  
    print "The word `%s` from block list is presnt in input '%s'"%(''.join(bloak_char), msg)
else:
    print "No word from block list is presnt in input '%s'"%(msg)
msg = "True test case ? Handle  daaaammaaaammnnnnn.,"
status, block_char = getbBlockListFlag(msg)
if status:  
    print "The word `%s` from block list is presnt in input '%s'"%(''.join(block_char), msg)
else:
    print "No word from block list is presnt in input '%s'"%(msg)

Output:

vivek@vivek:~/Desktop/stackoverflow$ python 16.py 
The word `damn` from block list is presnt in input 'True test case ? daaaammmmnnnnn.,'
The word `damn` from block list is presnt in input 'True test case ? normal damn.,'
No word from block list is presnt in input 'False test case ? nothing when sequance aaammdddnnn..'
No word from block list is presnt in input 'False test case ? nothing..'
No word from block list is presnt in input 'True test case ? Handle  daaaammaaaammnnnnn.,'

what if msg = "test masf to check shiiiiiiiit or daaaaammmmmmmn" — devo devox, Feb 15 '15 at 01:37
I know that's what I need if I input same word but have many same characters return True — devo devox, Feb 15 '15 at 01:45
ok, let me try again. means block list have item `damn` and input string have world like `daaammmnnn` then we have to return `True` otherwise `False` what about when input is `daaann`, return `False`(because `m` is missing) ?? what about when input is `amnd`(sequence is different) ?? — Vivek Sable, Feb 15 '15 at 01:50
what about when input is daaann, return False(because m is missing) - yes — devo devox, Feb 15 '15 at 01:52
what about when input is amnd(sequence is different) - return False — devo devox, Feb 15 '15 at 01:53
@devodevox: Welcome :) handled daammmaaannnnaaaa case also.. check now.. if you have any query then I can be reached anytime via email at vivekbsable@gmail.com, for my skype id: vivek.igp. — Vivek Sable, Feb 15 '15 at 02:36

Waqar Bin Kalim · Answer 2 · 2015-02-15T02:17:31.367

0

from collections import OrderedDict

string = "test this string to check for sshh-iitit and dammm.mn"
new_string = string.replace('-','')
final_string = new_string.replace('.','')
words = final_string.split()
for word in words:
    check = "".join(OrderedDict.fromkeys(word))
    if check == "damn" or check == "shit":
        print "true"

edited Feb 15 '15 at 02:17

answered Feb 15 '15 at 02:01

Waqar Bin Kalim

321
1
7

How does this handle cases like "daaaaaamn" – mac389 Feb 15 '15 at 02:07
@mac389 change foo to foo = "test this string to check for shhhhhhhhit and daaaaaammmmmmn" , it will print True – devo devox Feb 15 '15 at 02:15
I was suggesting that the proposed solution is not generalizable and could be by using regular expressions. – mac389 Feb 15 '15 at 11:32

score -1 · Answer 3 · edited Jul 13 '16 at 13:02

-1

You should have a look at the Levenshtein distance! PHP has this nice function called: leventhstein(). And for Phython is minimum one C implementation: https://pypi.python.org/pypi/python-Levenshtein/0.12.0

edited Jul 13 '16 at 13:02

niyasc

4,440
1
23
50

answered Jul 13 '16 at 10:06

row

131
2
11

Find similar word for word in the list

3 Answers3