BERT is not The Count: Learning to Match Mathematical Statements with Proofs

Waylon Li, Yftah Ziser, Maximin Coavoux, Shay B Cohen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

We introduce a task consisting in matching a proof to a given mathematical statement. The task fits well within current research on Mathematical Information Retrieval and, more generally, mathematical article analysis (Mathematical Sciences, 2014). We present a dataset for the task (the MATcH dataset) consisting of over 180k statement-proof pairs extracted from modern mathematical research articles. We find this dataset highly representative of our task, as it consists of relatively new findings useful to mathematicians. We propose a bilinear similarity model and two decoding methods to match statements to proofs effectively. While the first decoding method matches a proof to a statement without being aware of other statements or proofs, the second method treats the task as a global matching problem. Through a symbol replacement procedure, we analyze the "insights" that pre-trained language models have in such mathematical article analysis and show that while these models perform well on this task with the best performing mean reciprocal rank of 73.7, they follow a relatively shallow symbolic analysis and matching to achieve that performance.
Original languageEnglish
Title of host publicationProceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
EditorsAndreas Vlachos, Isabelle Augenstein
PublisherAssociation for Computational Linguistics
Pages3581-3593
Number of pages13
Publication statusPublished - 2 May 2023
EventThe 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023 - Dubrovnik, Croatia
Duration: 2 May 20236 May 2023
Conference number: 17
https://2023.eacl.org/

Conference

ConferenceThe 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023
Abbreviated titleEACL 2023
Country/TerritoryCroatia
CityDubrovnik
Period2/05/236/05/23
Internet address

Fingerprint

Dive into the research topics of 'BERT is not The Count: Learning to Match Mathematical Statements with Proofs'. Together they form a unique fingerprint.

Cite this