SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic

Ibrahim Abu Farha; Silviu Oprea; Steve Wilson; Walid Magdy

doi:10.18653/v1/2022.semeval-1.111

SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic

Ibrahim Abu Farha, Silviu Oprea, Steve Wilson, Walid Magdy

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

iSarcasmEval is the first shared task to target intended sarcasm detection: the data for this task was provided and labelled by the authors of the texts themselves. Such an approach minimises the downfalls of other methods to collect sarcasm data, which rely on distant supervision or third-party annotations. The shared task contains two languages, English and Arabic, and three subtasks: sarcasm detection, sarcasm category classification, and pairwise sarcasm identification given a sarcastic sentence and its non-sarcastic rephrase. The task received submissions from 60 different teams, with the sarcasm detection task being the most popular. Most of the participating teams utilised pre-trained language models. In this paper, we provide an overview of the task, data, and participating teams

Original language	English
Title of host publication	Proceedings of The 16th International Workshop on Semantic Evaluation 2022
Editors	Guy Emerson, Natalie Schluter, Gabriel Stanovsky, Ritesh Kumar, Alexis Palmer, Nathan Schneider, Siddharth Singh, Shyam Ratan
Place of Publication	Stroudsburg, PA, USA
Publisher	Association for Computational Linguistics
Pages	802-814
Number of pages	13
ISBN (Electronic)	978-1-955917-80-3
DOIs	https://doi.org/10.18653/v1/2022.semeval-1.111
Publication status	Published - 26 Jul 2022
Event	The 16th International Workshop on Semantic Evaluation 2022 - Duration: 14 Jul 2022 → 15 Jul 2022 Conference number: 16 https://semeval.github.io/SemEval2022/

Workshop

Workshop	The 16th International Workshop on Semantic Evaluation 2022
Abbreviated title	SemEval 2022
Period	14/07/22 → 15/07/22
Internet address	https://semeval.github.io/SemEval2022/

Access to Document

10.18653/v1/2022.semeval-1.111Licence: Creative Commons: Attribution (CC-BY)

SemEval-2022 Task 6_ABU FARHA_DOA31032022_VOR_CC-BYFinal published version, 228 KBLicence: Creative Commons: Attribution (CC-BY)

https://aclanthology.org/2022.semeval-1.111/Licence: Creative Commons: Attribution (CC-BY)

Cite this

Abu Farha, I., Oprea, S., Wilson, S., & Magdy, W. (2022). SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic. In G. Emerson, N. Schluter, G. Stanovsky, R. Kumar, A. Palmer, N. Schneider, S. Singh, & S. Ratan (Eds.), Proceedings of The 16th International Workshop on Semantic Evaluation 2022 (pp. 802-814). Association for Computational Linguistics. https://doi.org/10.18653/v1/2022.semeval-1.111

Abu Farha, Ibrahim ; Oprea, Silviu ; Wilson, Steve et al. / SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic. Proceedings of The 16th International Workshop on Semantic Evaluation 2022. editor / Guy Emerson ; Natalie Schluter ; Gabriel Stanovsky ; Ritesh Kumar ; Alexis Palmer ; Nathan Schneider ; Siddharth Singh ; Shyam Ratan. Stroudsburg, PA, USA : Association for Computational Linguistics, 2022. pp. 802-814

@inproceedings{cc67fe197c49406fbbb0aac5286482e4,

title = "SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic",

abstract = "iSarcasmEval is the first shared task to target intended sarcasm detection: the data for this task was provided and labelled by the authors of the texts themselves. Such an approach minimises the downfalls of other methods to collect sarcasm data, which rely on distant supervision or third-party annotations. The shared task contains two languages, English and Arabic, and three subtasks: sarcasm detection, sarcasm category classification, and pairwise sarcasm identification given a sarcastic sentence and its non-sarcastic rephrase. The task received submissions from 60 different teams, with the sarcasm detection task being the most popular. Most of the participating teams utilised pre-trained language models. In this paper, we provide an overview of the task, data, and participating teams",

author = "{Abu Farha}, Ibrahim and Silviu Oprea and Steve Wilson and Walid Magdy",

year = "2022",

month = jul,

day = "26",

doi = "10.18653/v1/2022.semeval-1.111",

language = "English",

pages = "802--814",

editor = "Guy Emerson and Natalie Schluter and Gabriel Stanovsky and Ritesh Kumar and Alexis Palmer and Nathan Schneider and Siddharth Singh and Shyam Ratan",

booktitle = "Proceedings of The 16th International Workshop on Semantic Evaluation 2022",

publisher = "Association for Computational Linguistics",

note = "The 16th International Workshop on Semantic Evaluation 2022<br/>, SemEval 2022 ; Conference date: 14-07-2022 Through 15-07-2022",

url = "https://semeval.github.io/SemEval2022/",

}

Abu Farha, I, Oprea, S, Wilson, S & Magdy, W 2022, SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic. in G Emerson, N Schluter, G Stanovsky, R Kumar, A Palmer, N Schneider, S Singh & S Ratan (eds), Proceedings of The 16th International Workshop on Semantic Evaluation 2022. Association for Computational Linguistics, Stroudsburg, PA, USA, pp. 802-814, The 16th International Workshop on Semantic Evaluation 2022
, 14/07/22. https://doi.org/10.18653/v1/2022.semeval-1.111

SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic. / Abu Farha, Ibrahim; Oprea, Silviu; Wilson, Steve et al.

Proceedings of The 16th International Workshop on Semantic Evaluation 2022. ed. / Guy Emerson; Natalie Schluter; Gabriel Stanovsky; Ritesh Kumar; Alexis Palmer; Nathan Schneider; Siddharth Singh; Shyam Ratan. Stroudsburg, PA, USA : Association for Computational Linguistics, 2022. p. 802-814.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic

AU - Abu Farha, Ibrahim

AU - Oprea, Silviu

AU - Wilson, Steve

AU - Magdy, Walid

N1 - Conference code: 16

PY - 2022/7/26

Y1 - 2022/7/26

N2 - iSarcasmEval is the first shared task to target intended sarcasm detection: the data for this task was provided and labelled by the authors of the texts themselves. Such an approach minimises the downfalls of other methods to collect sarcasm data, which rely on distant supervision or third-party annotations. The shared task contains two languages, English and Arabic, and three subtasks: sarcasm detection, sarcasm category classification, and pairwise sarcasm identification given a sarcastic sentence and its non-sarcastic rephrase. The task received submissions from 60 different teams, with the sarcasm detection task being the most popular. Most of the participating teams utilised pre-trained language models. In this paper, we provide an overview of the task, data, and participating teams

AB - iSarcasmEval is the first shared task to target intended sarcasm detection: the data for this task was provided and labelled by the authors of the texts themselves. Such an approach minimises the downfalls of other methods to collect sarcasm data, which rely on distant supervision or third-party annotations. The shared task contains two languages, English and Arabic, and three subtasks: sarcasm detection, sarcasm category classification, and pairwise sarcasm identification given a sarcastic sentence and its non-sarcastic rephrase. The task received submissions from 60 different teams, with the sarcasm detection task being the most popular. Most of the participating teams utilised pre-trained language models. In this paper, we provide an overview of the task, data, and participating teams

U2 - 10.18653/v1/2022.semeval-1.111

DO - 10.18653/v1/2022.semeval-1.111

M3 - Conference contribution

SP - 802

EP - 814

BT - Proceedings of The 16th International Workshop on Semantic Evaluation 2022

A2 - Emerson, Guy

A2 - Schluter, Natalie

A2 - Stanovsky, Gabriel

A2 - Kumar, Ritesh

A2 - Palmer, Alexis

A2 - Schneider, Nathan

A2 - Singh, Siddharth

A2 - Ratan, Shyam

PB - Association for Computational Linguistics

CY - Stroudsburg, PA, USA

T2 - The 16th International Workshop on Semantic Evaluation 2022<br/>

Y2 - 14 July 2022 through 15 July 2022

ER -

Abu Farha I, Oprea S, Wilson S, Magdy W. SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic. In Emerson G, Schluter N, Stanovsky G, Kumar R, Palmer A, Schneider N, Singh S, Ratan S, editors, Proceedings of The 16th International Workshop on Semantic Evaluation 2022. Stroudsburg, PA, USA: Association for Computational Linguistics. 2022. p. 802-814 doi: 10.18653/v1/2022.semeval-1.111