SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic

Ibrahim Abu Farha, Silviu Oprea, Steve Wilson, Walid Magdy

Research output: Chapter in Book/Report/Conference proceedingConference contribution


iSarcasmEval is the first shared task to target intended sarcasm detection: the data for this task was provided and labelled by the authors of the texts themselves. Such an approach minimises the downfalls of other methods to collect sarcasm data, which rely on distant supervision or third-party annotations. The shared task contains two languages, English and Arabic, and three subtasks: sarcasm detection, sarcasm category classification, and pairwise sarcasm identification given a sarcastic sentence and its non-sarcastic rephrase. The task received submissions from 60 different teams, with the sarcasm detection task being the most popular. Most of the participating teams utilised pre-trained language models. In this paper, we provide an overview of the task, data, and participating teams
Original languageEnglish
Title of host publicationProceedings of The 16th International Workshop on Semantic Evaluation 2022
EditorsGuy Emerson, Natalie Schluter, Gabriel Stanovsky, Ritesh Kumar, Alexis Palmer, Nathan Schneider, Siddharth Singh, Shyam Ratan
Place of PublicationStroudsburg, PA, USA
PublisherAssociation for Computational Linguistics
Number of pages13
ISBN (Electronic) 978-1-955917-80-3
Publication statusPublished - 26 Jul 2022
EventThe 16th International Workshop on Semantic Evaluation 2022
Duration: 14 Jul 202215 Jul 2022
Conference number: 16


WorkshopThe 16th International Workshop on Semantic Evaluation 2022
Abbreviated titleSemEval 2022
Internet address

Cite this