TransModal: Translating from Multiple Modalities into Text

Research output

Research output per year 2016 2017 2018 2024

• 43 Conference contribution
• 7 Article

Research output per year

Research output per year

Search results

• 2024

  Explainability and hate speech: Structured explanations make social media moderators faster

  Calabrese, A., Neves, L., Shah, N., Bos, M. W., Ross, B., Lapata, M. & Barbieri, F., 16 May 2024, (Accepted/In press) Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics. ACL Anthology

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Published Research 100%
  • Decision-Making 100%
  • Decision Making 100%
• 2022

  Improving Translation of Out Of Vocabulary Words using Bilingual Lexicon Induction in Low-Resource Machine Translation

  Waldendorf, J., Birch, A., Haddow, B. & Miceli Barone, A. V., 16 Sept 2022, Proceedings of the 15th biennial conference of the Association for Machine Translation in the Americas (Volume 1: Research Track). Duh, K., Guzman, F. & Richardson, S. (eds.). Orlando, USA: Association for Machine Translation in the Americas, AMTA, p. 144-156 13 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Monolingual 100%
  • Automatic Translation 100%
  • bi-lingual lexicon 100%
  • Machine Translation 100%
  • Training Data 66%

• Distributionally Robust Recurrent Decoders with Random Network Distillation

  Valerio Miceli Barone, A., Birch, A. & Sennrich, R., 3 Jun 2022, Proceedings of the 7th Workshop on Representation Learning for NLP. Gella, S., He, H., Majumdar, B. P., Can, B., Giunchiglia, E., Cahyawijaya, S., Min, S., Mozes, M., Li, X. L., Augenstein, I., Rogers, A., Cho, K., Grefenstette, E., Rimell, L. & Dyer, C. (eds.). Dublin, Ireland: Association for Computational Linguistics, p. 1-8 8 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Autoregressive Language Model 100%

• Hierarchical Sketch Induction for Paraphrase Generation

  Hosking, T., Tang, H. & Lapata, M., 1 May 2022, Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Dublin, Ireland: Association for Computational Linguistics, p. 2489-2501 13 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Syntactics 100%
  • Autoencoder 100%
  • Variational Autoencoder 75%
  • Test Time 33%
  • Generative Model 33%
• 2021

  Factorising Meaning and Form for Intent-Preserving Paraphrasing

  Hosking, T. & Lapata, M., 1 Aug 2021, Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Association for Computational Linguistics, p. 1405-1418 14 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Syntactics 100%
  • Training Objective 100%
  • Variational Autoencoder 100%
  • External Source 100%
  • Surface Form 100%

• Text Generation from Discourse Representation Structures

  Liu, J., Cohen, S. B. & Lapata, M., 6 Jun 2021, Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Online: Association for Computational Linguistics, p. 397-415 19 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Discourse Representation Structure 100%
  • Level Representation 16%
• 2020

  Zero-Shot Crosslingual Sentence Simplification

  Mallinson, J., Sennrich, R. & Lapata, M., 16 Nov 2020, Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics (ACL), p. 5109-5126 18 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Modeling Framework 100%

• Screenplay Summarization Using Latent Narrative Structure

  Papalampidi, P., Keller, F., Frermann, L. & Lapata, M., 10 Jul 2020, Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Online: Association for Computational Linguistics, p. 1920-1933 14 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Extractive Summarization 100%
  • Information Present 50%
  • Smart Selection 50%
  • Level Summarization 50%
  • Experimental Result 50%
• 2019

  Movie Plot Analysis via Turning Point Identification

  Papalampidi, P., Keller, F. & Lapata, M., 4 Nov 2019, Proceedings of the Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on NLP. Association for Computational Linguistics (ACL), p. 1707–1717 14 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Narrative 100%
  • Neural Network 100%
  • Network Model 100%
  • Neural Network Model 100%
  • Plot structure 14%

• Semantic Graph Parsing with Recurrent Neural Network DAG Grammars

  Fancellu, F., Gilroy, S., Lopez, A. & Lapata, M., 4 Nov 2019, Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing. Association for Computational Linguistics, p. 2769–2778 13 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Parsing 100%
  • Recurrent Neural Network 100%
  • Directed Acyclic Graph 100%
  • Neural Network 100%
  • Sequence Model 66%

• Learning Semantic Parsers from Denotations with Latent Structured Alignments and Abstract Programs

  Wang, B., Titov, I. & Lapata, M., 3 Nov 2019, Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Hong Kong, China: Association for Computational Linguistics, p. 3765-3776 12 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Parsing 100%
  • Search Space 50%
  • Dynamic Programming 50%
  • Art Performance 50%
  • Fragment Program 50%

• Generating Summaries with Topic Templates and Structured Convolutional Decoders

  Perez-Beltrachini, L., Liu, Y. & Lapata, M., 31 Jul 2019, Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Florence, Italy: Association for Computational Linguistics, p. 5107-5116 10 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Representing Set 100%
  • Content Structure 100%
  • Sequential Decoder 100%

• Single Document Summarization as Tree Induction

  Liu, Y., Titov, I. & Lapata, M., 7 Jun 2019, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics. Burstein, J., Doran, C. & Solorio, T. (eds.). Minneapolis, Minnesota: Association for Computational Linguistics (ACL), Vol. 1. p. 1745–1755 11 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Extractive Summarization 100%
  • Document Representation 100%
  • Iterative Refinement 100%

• Text Generation from Knowledge Graphs with Graph Transformers

  Koncel-Kedziorski, R., Bekal, D., Luan, Y., Lapata, M. & Hajishirzi, H., 7 Jun 2019, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics. Burstein, J., Doran, C. & Solorio, T. (eds.). Minneapolis, Minnesota: Association for Computational Linguistics (ACL), Vol. 1. p. 2284–2293 10 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Knowledge Graph 100%
  • Information Extraction 33%
  • Relational Structure 33%
  • Structured Representation 33%

• Discourse Representation Structure Parsing with Recurrent Neural Networks and the Transformer Model

  Liu, J., Cohen, S. B. & Lapata, M., 23 May 2019, Proceedings of the IWCS Shared Task on Semantic Parsing. Gothenburg, Sweden: Association for Computational Linguistics, 6 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Parsing 100%
  • Recurrent Neural Network 100%
  • Discourse Representation Structure 100%
  • Open Source 25%
  • Translation System 25%
• 2018

  Deep Graph Convolutional Encoders for Structured Data to Text Generation

  Marcheggiani, D. & Perez-Beltrachini, L., Nov 2018, Proceedings of the 11th International Conference on Natural Language Generation . Tilburg University, The Netherlands : Association for Computational Linguistics, p. 1-9 9 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Coder 100%
  • Structured Data 100%
  • Convolutional Encoder 100%
  • Recurrent Neural Network 100%
  • Graph Convolutional Network 50%

• Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization

  Narayan, S., Cohen, S. & Lapata, M., Nov 2018, Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Brussels, Belgium : Association for Computational Linguistics, p. 1797-1807 11 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Convolutional Neural Network 100%
  • And-States 50%
  • Range Dependency 50%

• Neural Latent Extractive Document Summarization

  Zhang, X., Lapata, M., Wei, F. & Zhou, M., Nov 2018, Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Brussels, Belgium: Association for Computational Linguistics, p. 779-784 6 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Extractive Summarization 100%
  • Convolutional Neural Network 100%

• Sentence Compression for Arbitrary Languages via Multilingual Pivoting

  Mallinson, J., Sennrich, R. & Lapata, M., Nov 2018, 2018 Conference on Empirical Methods in Natural Language Processing. Brussels, Belgium: Association for Computational Linguistics, p. 2453-2464 12 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Model Compression 100%
  • Translating (Language) 100%
  • Machine Translation 50%

• Structured Alignment Networks for Matching Sentences

  Liu, Y., Gardner, M. & Lapata, M., Nov 2018, 2018 Conference on Empirical Methods in Natural Language Processing. Brussels, Belgium: Association for Computational Linguistics, p. 1554-1564 11 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Sentence Structure 100%
  • Natural Language Processing 50%
  • Preprocessing Step 50%
  • Latent Structure 50%
  • Superior Performance 50%

• Summarizing Opinions: Aspect Extraction Meets Sentiment Prediction and They Are Both Weakly Supervised

  Angelidis, S. & Lapata, M., Nov 2018, Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing . Brussels, Belgium: Association for Computational Linguistics, p. 3675-3686 12 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Sentiment Prediction 100%
  • Summarizing Opinion 100%
  • Opinion Summarization 100%
  • Annotation 50%
  • Multiple Instance 50%

• Weakly-supervised Neural Semantic Parsing with a Generative Ranker

  Cheng, J. & Lapata, M., Oct 2018, SIGNLL Conference on Computational Natural Language Learning (CoNLL 2018). Brussels, Belgium: Association for Computational Linguistics, p. 356-367 12 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Candidate Tree 100%

• Coarse-to-Fine Decoding for Neural Semantic Parsing

  Dong, L. & Lapata, M., 20 Jul 2018, Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Melbourne, Australia : Association for Computational Linguistics, p. 731-742 12 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Parsing 100%
  • Language Input 50%
  • Parsing Process 50%
  • Input Utterance 50%
  • Experimental Result 50%

• Confidence Modeling for Neural Semantic Parsing

  Dong, L., Quirk, C. & Lapata, M., Jul 2018, Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) . Melbourne, Australia: Association for Computational Linguistics, p. 743-753 11 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Parsing 100%
  • Confidence Estimation 100%
  • Sequence Model 100%
  • Confidence Score 100%
  • Model Prediction 100%

• Discourse Representation Structure Parsing

  Liu, J., Cohen, S. & Lapata, M., Jul 2018, 56th Annual Meeting of the Association for Computational Linguistics. Melbourne, Australia: Association for Computational Linguistics (ACL), p. 429-439 11 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Parsing 100%
  • Discourse Representation Structure 100%
  • Discourse Representation 33%
  • Experimental Result 33%
  • Decoding Process 33%

• Document Modeling with External Attention for Sentence Extraction

  Narayan, S., Cardenas, R., Papasarantopoulos, N., Cohen, S., Lapata, M., Yu, J. & Chang, Y., Jul 2018, 56th Annual Meeting of the Association for Computational Linguistics. Melbourne, Australia : Association for Computational Linguistics, p. 2020-2030 11 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • TensorFlow 100%

• Bootstrapping Generators from Noisy Data

  Perez-Beltrachini, L. & Lapata, M., 30 Jun 2018, The 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. New Orleans, Louisiana : Association for Computational Linguistics, p. 1516-1527 12 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Instance Learning 100%
  • Statistical Data 100%
  • Experimental Result 100%
  • Structured Data 100%
  • Data Representation 100%

• What’s This Movie About? A Joint Neural Network Architecture for Movie Content Analysis

  Gorinski, P. J. & Lapata, M., 30 Jun 2018, Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. New Orleans, Louisiana, USA: Association for Computational Linguistics (ACL), Vol. 1. p. 1770-1781 12 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Neural Network Architecture 100%
  • Content Analysis 100%
  • Attribute Value 50%
  • Long Short-Term Memory Network 50%

• Ranking Sentences for Extractive Summarization with Reinforcement Learning

  Narayan, S., Cohen, S. B. & Lapata, M., 6 Jun 2018, Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). New Orleans, Louisiana : Association for Computational Linguistics (ACL), p. 1747-1759 13 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Reinforcement Learning 100%
  • Extractive Summarization 100%
  • Evaluation Metric 50%
  • Convolutional Neural Network 50%
  • Information Content 50%
• 2017

  Image Pivoting for Learning Multilingual Multimodal Representations

  Gella, S., Sennrich, R., Keller, F. & Lapata, M., 11 Sept 2017, Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Copenhagen, Denmark: Association for Computational Linguistics (ACL), p. 2839-2845 7 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Textual Semantic Similarity 100%

• Learning to Paraphrase for Question Answering

  Dong, L., Mallinson, J., Reddy, S. & Lapata, M., 11 Sept 2017, Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, p. 886–897 12 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Answer Question 100%
  • Experimental Result 100%
  • question answering system 100%

• Sentence Simplification with Deep Reinforcement Learning

  Zhang, X. & Lapata, M., 11 Sept 2017, Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Copenhagen, Denmark : Association for Computational Linguistics, p. 584-594 11 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Deep Reinforcement Learning 100%
  • Automatic Translation 100%
  • Machine Translation 100%
  • Reinforcement Learning 100%
  • Learning Framework 50%

• Universal Semantic Parsing

  Reddy, S., Täckström, O., Petrov, S., Steedman, M. & Lapata, M., 11 Sept 2017, Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Copenhagen, Denmark : Association for Computational Linguistics, p. 89–101 13 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Parsing 100%
  • Dependency Graph 100%
  • Syntactics 50%
  • Semantic Interface 50%
  • Syntactic Representation 50%

• Learning Contextually Informed Representations for Linear-Time Discourse Parsing

  Liu, Y. & Lapata, M., 1 Sept 2017, Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Copenhagen, Denmark: Association for Computational Linguistics, p. 1300-1309 10 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Parsing 100%
  • Neural Network 50%
  • Time Complexity 50%
  • Contextual Information 50%
  • Art Performance 50%

• A generative parser with a discriminative recognition algorithm

  Cheng, J., Lopez, A. & Lapata, M., 4 Aug 2017, 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017). Association for Computational Linguistics, p. 118-124 7 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Language Modeling 100%
  • Parsing 100%
  • Recognition Algorithm 100%
  • Generative Model 50%
  • Parse Tree 25%

• Learning structured natural language representations for semantic parsing

  Cheng, J., Reddy, S., Saraswat, V. & Lapata, M., 4 Aug 2017, (E-pub ahead of print) ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers). Association for Computational Linguistics (ACL), Vol. 1. p. 44-55 12 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Parsing 100%
  • Representation Language 100%
  • Argument Structure 100%
  • Transition System 50%

• Dependency Parsing as Head Selection

  Zhang, X., Cheng, J. & Lapata, M., 7 Apr 2017, Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers. Association for Computational Linguistics (ACL), p. 665-676 12 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Spanning Tree Algorithm 100%

• Learning to Generate Product Reviews from Attributes

  Dong, L., Huang, S., Wei, F., Lapata, M., Zhou, M. & Xu, K., 7 Apr 2017, Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers. Association for Computational Linguistics, p. 623-632 10 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Input Attribute 100%

• Paraphrasing Revisited with Neural Machine Translation

  Mallinson, J., Sennrich, R. & Lapata, M., 7 Apr 2017, Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers. Association for Computational Linguistics (ACL), p. 881-893 13 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Machine Translation 100%
  • Neural Network 50%
  • Natural Language Processing 50%
  • Continuous Space 50%
  • Text Segment 50%
• 2016

  Long Short-Term Memory-Networks for Machine Reading

  Cheng, J., Dong, L. & Lapata, M., 5 Nov 2016, Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, p. 551-561 11 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Language Modeling 100%
  • Memory Architecture 100%
  • Sentiment Analysis 100%
  • Long Short-Term Memory Network 100%
  • Lstm 100%

• Language to logical form with neural attention

  Dong, L. & Lapata, M., 12 Aug 2016, 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016 - Long Papers. Association for Computational Linguistics (ACL), Vol. 1. p. 33-43 11 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Parsing 100%
  • Input Utterance 100%
  • Experimental Result 100%
  • Output Sequence 100%

• Neural Semantic Role Labeling with Dependency Path Embeddings

  Roth, M. & Lapata, M., 12 Aug 2016, Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. Berlin, Germany: Association for Computational Linguistics, p. 1192-1202 11 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Semantic Role Labeling 100%
  • Syntactics 50%

• Neural Summarization by Extracting Sentences and Words

  Cheng, J. & Lapata, M., 12 Aug 2016, Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. Berlin, Germany: Association for Computational Linguistics, p. 484-494 11 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  Open Access

  File

  • Neural Network 100%
  • Annotation 100%
  • Driven Approach 100%
  • Extractive Summarization 100%
  • Experimental Result 100%