Tagging Markfast

Question

I'm using Markfast as below

Script:

WORDLIST PARTICLESLIST = 'NameswithParticles.txt';
DECLARE PARTICLES;
Document{ -> MARKFAST(PARTICLES, PARTICLESLIST,true)};

NameswithParticles.txt:

der
Der
de
De
d'
D'
De la
de La 
de la
von
Von
van
Van
ten
La
la
Le
le
L'
St
Al
al
O'

Sample Input :

1.der Waals radius
2.van Minh
3.Der Brul
4.de Brul

It tags all the above particle names except der and Der.

I cannot reproduce the problem. I get four `PARTICLES` annotations. If `MARKFAST` misses matches, there are most likely whitespaces in the txt file in my experience. — Peter Kluegl, Nov 02 '16 at 08:06
@PeterKluegl,I tried the above question. I also faced the same issue — Sugunalakshmi Pagemajik, Nov 05 '16 at 06:38
Hmmm, I have no idea yet what the problem might be. Is there maybe something special about the DocumentAnnotation? — Peter Kluegl, Nov 07 '16 at 07:37
Sorry For me its BOM issue.Now I'm also getting four PARTICLES — Sugunalakshmi Pagemajik, Nov 08 '16 at 03:51
Whether the WORDLIST given above is what you are using or Its a sample Wordlist? — Sugunalakshmi Pagemajik, Nov 08 '16 at 04:41
If its a sample file Pls update the wordlist. This issue may also cause due to Whitespace. — Sugunalakshmi Pagemajik, Nov 08 '16 at 05:00

score 1 · Answer 1 · edited May 23 '17 at 12:08

1

Yeah its due to Whitespace. So active the dictRemoveWS in configuration parameter.View the comments for more details Wordlist -uima ruta

edited May 23 '17 at 12:08

Community

answered Nov 08 '16 at 06:47

How to Configure dictRemoveWS in the Script itself – prasanth Nov 08 '16 at 07:28
This is an open issue. There is no way to set this by rules, only in the configuration parameters – Peter Kluegl Nov 09 '16 at 09:37

1 Answers1