Ambiguity resolution analysis in incremental parsing of natural language

Fabrizio Costa, Paolo Frasconi, Vincenzo Lombardo, Patrick Sturt, Giovanni Soda

Research output: Contribution to journalArticlepeer-review

Abstract / Description of output

Incremental parsing gains its importance in natural language processing and psycholinguistics because of its cognitive plausibility. Modeling the associated cognitive data structures, and their dynamics, can lead to a better understanding of the human parser. In earlier work, we have introduced a recursive neural network (RNN) capable of performing syntactic ambiguity resolution in incremental parsing. In this paper, we report a systematic analysis of the behavior of the network that allows us to gain important insights about the kind of information that is exploited to resolve different forms of ambiguity. In attachment ambiguities, in which a new phrase can be attached at more than one point in the syntactic left context, we found that learning from examples allows us to predict the location of the attachment point with high accuracy, while the discrimination amongst alternative syntactic structures with the same attachment point is slightly better than making a decision purely based on frequencies. We also introduce several new ideas to enhance the architectural design, obtaining significant improvements of prediction accuracy, up to 25% error reduction on the same dataset used in previous work. Finally, we report large scale experiments on the entire Wall Street Journal section of the Penn Treebank. The best prediction accuracy of the model on this large dataset is 87.6%, a relative error reduction larger than 50% compared to previous results.
Original languageEnglish
Pages (from-to)959-71
Number of pages13
JournalIEEE Transactions on Neural Networks
Volume16
Issue number4
DOIs
Publication statusPublished - 2005

Keywords / Materials (for Non-textual outputs)

  • Algorithms
  • Linguistics
  • Natural Language Processing
  • Neural Networks (Computer)
  • Pattern Recognition, Automated
  • Vocabulary, Controlled

Fingerprint

Dive into the research topics of 'Ambiguity resolution analysis in incremental parsing of natural language'. Together they form a unique fingerprint.

Cite this