Approaching Neural Chinese Word Segmentation as a Low-Resource Machine Translation Task

Pinzhen Chen, Kenneth Heafield

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as characterlevel translation, which further simplified model designing, but there is a performance gap between the translation-based approach and other methods. This motivates our work, in which we apply the best practices from lowresource neural machine translation to supervised Chinese segmentation. We examine a series of techniques including regularization, data augmentation, objective weighting, transfer learning, and ensembling. Compared to previous works, our low-resource translationbased method maintains the effortless model design, yet achieves the same result as state of the art in the constrained evaluation without using additional data.
Original languageEnglish
Title of host publicationProceedings of the 36th Pacific Asia Conference on Language, Information and Computation
EditorsShirley Dita, Arlene Trillanes, Rochelle Irene Lucas
Place of PublicationManila, Philippines
PublisherAssociation for Computational Linguistics
Pages600-606
Number of pages7
Publication statusPublished - 1 Oct 2022
Event36th Pacific Asia Conference on Language, Information and Computation - Manila, Philippines
Duration: 20 Oct 202222 Oct 2022
Conference number: 36

Conference

Conference36th Pacific Asia Conference on Language, Information and Computation
Abbreviated titlePACLIC
Country/TerritoryPhilippines
CityManila
Period20/10/2222/10/22

Fingerprint

Dive into the research topics of 'Approaching Neural Chinese Word Segmentation as a Low-Resource Machine Translation Task'. Together they form a unique fingerprint.

Cite this