13

Is there a way to get the subject of a sentence using OpenNLP? I'm trying to identify the most important part of a users sentence. Generally, users will be submitting sentences to our "engine" and we want to know exactly what the core topic is of that sentence.

Currently we are using openNlp to:

  1. Chunk the sentence
  2. Identify the noun-phrase, verbs, etc of the sentence
  3. Identify all "topics" of the sentence
  4. (NOT YET DONE!) Identify the "core topic" of the sentence

Please let me know if you have any bright ideas..

MWiesner
  • 8,868
  • 11
  • 36
  • 70
rockit
  • 3,708
  • 7
  • 26
  • 36
  • 2
    There are two meanings of 'subject'. Do you mean grammatical subject (like how a sentence has a subject, verb and object) or do you mean what the sentence is 'about' in a more general sense? – Stompchicken Apr 06 '11 at 08:10

2 Answers2

17

Dependency Parser

If you're interested in extracting grammatical relations such as what word or phrase is the subject of a sentence, you should really use a dependency parser. While OpenNLP does support phrase structure parsing, I don't think it does dependency parsing yet.

Opensource Software

Packages written in Java that support dependency parsing include:

Of these, the Stanford Parser is the most accurate. However, some configurations of the MaltParser can be insanely fast (Cer et al. 2010).

dmcer
  • 8,116
  • 1
  • 35
  • 41
2

For the grammatical subject you'd need to rely on configurational information in the tree. If the parse looks something like (TOP (S (NP ----) (VP ----))) then you can take the NP as the subject; often, though not at all always, that will be the case. However only some sentences will have this configuration; one can easily imagine structures with subjects that are not in that position -- passive constructions, for example.

You're probably better off using MaltParser though.

John Stewart
  • 343
  • 2
  • 11