Projects per year
Abstract
A recent distributional approach to word-analogy problems (Mikolov et al., 2013b) exploits interesting regularities in the structure of the space of representations. Investigating further, we find that performance on this task can also be related to orthogonality within the space. Explicitly designing such structure into a neural network model results in representations that decompose into orthogonal semantic and syntactic subspaces. We demonstrate that using word-order and morphological structure within English Wikipedia text to enable this decomposition can produce substantial improvements on semantic-similarity, pos-induction and word-analogy tasks.
Original language | English |
---|---|
Title of host publication | Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics (ACL) |
Publisher | Association for Computational Linguistics |
Pages | 1301-1310 |
Number of pages | 10 |
ISBN (Print) | 978-1-941643-72-3 |
Publication status | Published - 2015 |
Fingerprint
Dive into the research topics of 'Orthogonality of Syntax and Semantics within Distributional Spaces'. Together they form a unique fingerprint.Projects
- 2 Finished
-
Xperience - 'Robotes Bootstrapped through Learning from Experience'
Steedman, M., Geib, C. & Petrick, R.
1/01/10 → 31/12/15
Project: Research