Stack Overflow
Stack Overflow

Questions tagged [lingpipe]

LingPipe is tool kit for processing text using computational linguistics.

Overview

LingPipe is Java based Natural Language Processing toolkit for text mining and analysis. LingPipe can be used to do tasks like:

  • Named Entity Recognition
  • Sentiment Analysis on Twitter Feeds
  • Suggest spelling corrections

Architecture Overview

LingPipe's architecture is designed to be efficient, scalable, reusable, and robust. Highlights include:

  • Java API with source code and unit tests;
  • multi-lingual, multi-domain, multi-genre models;
  • training with new data for new tasks;
  • n-best output with statistical confidence estimates;
  • online training (learn-a-little, tag-a-little);
  • thread-safe models and decoders for concurrent-read exclusive-write (CREW) synchronization; and
  • character encoding-sensitive I/O.

Licence

LingPipe is available under various licences ranging from free to commercial. These include:

  • Affero General Public License (AGPL) (Non-Commercial)
  • Developer (Commercial)
  • Start Up (Commercial)
  • Enterprise Server (Commercial)
27 questions
7
votes
4 answers

Entity Recognition and Sentiment Analysis using NLP

So, this question might be a little naive, but I thought asking the friendly people of Stackoverflow wouldn't hurt. My current company has been using a third party API for NLP for a while now. We basically URL encode a string and send it over, and…
user3457860
  • 71
  • 1
  • 2
6
votes
1 answer

Should I use LingPipe or NLTK for extracting names and places?

I'm looking to extract names and places from very short bursts of text example "cardinals vs jays in toronto" " Daniel Nestor and Nenad Zimonjic play Jonas Bjorkman w/ Kevin Ullyett, paris time to be announced" "jenson button - pole position,…
pedalpete
  • 21,076
  • 45
  • 128
  • 239
4
votes
2 answers

Classifying data with naive bayes using LingPipe

I want to classify certain data into different classes based on its content. I did it using naive bayes classifier and I get an output as the best category to which it belongs. But now I want to classify the news other than those in the training set…
lulu
  • 177
  • 1
  • 1
  • 9
3
votes
3 answers

Exact Dictionary based Named Entity Recognition with Stanford

I have a dictionary of named entities, extracted from Wikipedia. I want to use it as the dictionary of an NER. I wanted to know how can I use Stanford-NER with this data of mine. I have also downloaded Lingpipe, although I have no idea how can I use…
Hedieh
  • 43
  • 8
3
votes
1 answer

Named Entity recognition in Gate using LingPipe

I'm using GATE NLP to process my document, and I want to Use entity names to use as tag candidates In Gate there are OpenNLP and LingPipe as I read an answer form here @Shashikant Kore answer he said if you have the sentence "My friend Joe Smith…
Abeer zaroor
  • 320
  • 2
  • 17
3
votes
1 answer

Using Latent Semantic Analysis to measure passage similarity

Im currently developing a program to compare two pieces of text based on its semantics (meaning). I understand there are libraries such as lingpipe which provide useful methods to compare string distances, however i've heard that LSA is the best…
kype
  • 555
  • 1
  • 6
  • 24
2
votes
0 answers

Classifying data inside mongodb using naiva bayes

I want to classify news in the mongodb database to certain specific categories using Naive Bayes. My training data contains different set of news of the fields sports, arts, entertainment etc. I have to train this data and build a model and then…
chopss
  • 771
  • 9
  • 19
2
votes
1 answer

What is the use of lucene index files in DBPedia-Spotlight..?

I am trying to find named entities in a given text. For that, I have tried using DBPedia spotlight service. I am able to get a response out of that. However, the DBPedia dataset is limited, so I tried replacing their spotter.dict file with my own…
Sreedhar GS
  • 2,694
  • 1
  • 24
  • 26
1
vote
1 answer

Can not identify text in Spanish with Lingpipe

Some days ago, I am developing an java server to keep a bunch of data and identify its language, so I decided to use lingpipe for such task. But I have facing an issue, after training code and evaluating it with two languages(English and Spanish) by…
Samuel Cruz
  • 11
  • 5
1
vote
0 answers

Using LingPipe in android for NLP

According to this answer, LingPipe is a good library to use in Java. I want to know if it can be used for android too. If possible, a link to sample code will be helpful. Mainly I am looking for offline sentiment analysis. If there are better…
Rishabh Maltare
  • 161
  • 2
  • 12
1
vote
0 answers

LingPipe POS tagger runs out of memory

I'm having trouble using the LingPipe POS tagger to count the most frequently used parts of speech in a large (~180MB) corpus of e-mails. Specifically, it consumes enormous amounts of memory (at least 4GB), such that no matter how much memory I give…
Edward
  • 5,942
  • 4
  • 38
  • 55
1
vote
1 answer

How i can use LingPipe Tools to extract Arabic named entity

I'm trying to use Lingpipe tools to extract named entity recognition (Persons name) from Arabic text. I was read a tutorial about this tools http://alias-i.com/lingpipe/demos/tutorial/ne/read-me.html how i can save the results in file. Thanks
user3672011
  • 13
  • 4
1
vote
1 answer

Classification using Bernoulli classifier in Lingpipe

I want to classify my data through bernoulli classifier in lingpipe If someone has the working method for it, please share
Faheem Shoaib
  • 11
  • 1
0
votes
0 answers

how can i get the word sequence of a concatenated words by java?

I want to get the word sequence of a combining words, like a variable name - "NullPointException". I want to get the "Null","point","Exception" by java. So, Are there any open source libraries for java that I can use? Or what such tasks are called…
Link
  • 19
  • 2
0
votes
0 answers

Java's LingPipe error

I have no experience using java, i am trying to use lingpipe on windows (on linux everything worked perfectly) with command shell commands. But keep getting an error message. these are the commands: cd…
Swishderzy
  • 1
1
2