NADI 2024: The fifth nuanced Arabic dialect identification shared task

Muhammad  Abdul-Mageed; Amr Keleg; AbdelRahim Elmadany; Chiyu Zhang; Injy Hamed; Walid Magdy; Houda Bouamor; Nizar Habash

doi:10.18653/v1/2024.arabicnlp-1.79

NADI 2024: The fifth nuanced Arabic dialect identification shared task

Muhammad Abdul-Mageed, Amr Keleg, AbdelRahim Elmadany, Chiyu Zhang, Injy Hamed, Walid Magdy, Houda Bouamor, Nizar Habash

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract / Description of output

We describe the findings of the fifth Nuanced Arabic Dialect Identification Shared Task (NADI 2024). NADI's objective is to help advance SoTA Arabic NLP by providing guidance, datasets, modeling opportunities, and standardized evaluation conditions that allow researchers to collaboratively compete on pre-specified tasks. NADI 2024 targeted both dialect identification cast as a multi-label task (Subtask~1), identification of the Arabic level of dialectness (Subtask~2), and dialect-to-MSA machine translation (Subtask~3). A total of 51 unique teams registered for the shared task, of whom 12 teams have participated (with 76 valid submissions during the test phase). Among these, three teams participated in Subtask~1, three in Subtask~2, and eight in Subtask~3. The winning teams achieved 50.57 F\textsubscript{1} on Subtask~1, 0.1403 RMSE for Subtask~2, and 20.44 BLEU in Subtask~3, respectively. Results show that Arabic dialect processing tasks such as dialect identification and machine translation remain challenging. We describe the methods employed by the participating teams and briefly offer an outlook for NADI.

Original language	English
Title of host publication	Proceedings of The Second Arabic Natural Language Processing Conference
Editors	Nizar Habash, Houda Bouamor, Ramy Eskander, Nadi Tomeh, Ibrahim Abu Farha, Ahmed Abdelali, Samia Touileb, Injy Hamed, Yaser Onaizan, Bashar Alhafni, Wissam Antoun, Salam Khalifa, Hatem Haddad, Imed Zitouni, Badr AlKhamissi, Rawan Almatham, Khalil Mrini
Publisher	Association for Computational Linguistics (ACL)
Pages	709-728
Number of pages	20
Edition	2
ISBN (Electronic)	9798891761322
DOIs	https://doi.org/10.18653/v1/2024.arabicnlp-1.79
Publication status	Published - 16 Aug 2024
Event	The Second Arabic Natural Language Processing Conference - Hybrid, Bangkok, Thailand Duration: 16 Aug 2024 → 16 Aug 2024 Conference number: 2 https://arabicnlp2024.sigarab.org/

Conference

Conference	The Second Arabic Natural Language Processing Conference
Abbreviated title	ArabicNLP 2024
Country/Territory	Thailand
City	Bangkok
Period	16/08/24 → 16/08/24
Internet address	https://arabicnlp2024.sigarab.org/

Keywords / Materials (for Non-textual outputs)

computation and language
artificial intelligence

Access to Document

10.18653/v1/2024.arabicnlp-1.79Licence: Creative Commons: Attribution (CC-BY)

AbdulMageedEtalArabicNLP2024NADI2024TheFifthNuancedFinal published version, 1.07 MBLicence: Creative Commons: Attribution (CC-BY)

Cite this

Abdul-Mageed, M., Keleg, A., Elmadany, A., Zhang, C., Hamed, I., Magdy, W., Bouamor, H., & Habash, N. (2024). NADI 2024: The fifth nuanced Arabic dialect identification shared task. In N. Habash, H. Bouamor, R. Eskander, N. Tomeh, I. A. Farha, A. Abdelali, S. Touileb, I. Hamed, Y. Onaizan, B. Alhafni, W. Antoun, S. Khalifa, H. Haddad, I. Zitouni, B. AlKhamissi, R. Almatham, & K. Mrini (Eds.), Proceedings of The Second Arabic Natural Language Processing Conference (2 ed., pp. 709-728). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2024.arabicnlp-1.79

Abdul-Mageed, Muhammad ; Keleg, Amr ; Elmadany, AbdelRahim et al. / NADI 2024 : The fifth nuanced Arabic dialect identification shared task. Proceedings of The Second Arabic Natural Language Processing Conference. editor / Nizar Habash ; Houda Bouamor ; Ramy Eskander ; Nadi Tomeh ; Ibrahim Abu Farha ; Ahmed Abdelali ; Samia Touileb ; Injy Hamed ; Yaser Onaizan ; Bashar Alhafni ; Wissam Antoun ; Salam Khalifa ; Hatem Haddad ; Imed Zitouni ; Badr AlKhamissi ; Rawan Almatham ; Khalil Mrini. 2. ed. Association for Computational Linguistics (ACL), 2024. pp. 709-728

@inproceedings{9ff3a744fd8848eaa049e97dd2a82663,

title = "NADI 2024: The fifth nuanced Arabic dialect identification shared task",

abstract = "We describe the findings of the fifth Nuanced Arabic Dialect Identification Shared Task (NADI 2024). NADI's objective is to help advance SoTA Arabic NLP by providing guidance, datasets, modeling opportunities, and standardized evaluation conditions that allow researchers to collaboratively compete on pre-specified tasks. NADI 2024 targeted both dialect identification cast as a multi-label task (Subtask~1), identification of the Arabic level of dialectness (Subtask~2), and dialect-to-MSA machine translation (Subtask~3). A total of 51 unique teams registered for the shared task, of whom 12 teams have participated (with 76 valid submissions during the test phase). Among these, three teams participated in Subtask~1, three in Subtask~2, and eight in Subtask~3. The winning teams achieved 50.57 F\textsubscript{1} on Subtask~1, 0.1403 RMSE for Subtask~2, and 20.44 BLEU in Subtask~3, respectively. Results show that Arabic dialect processing tasks such as dialect identification and machine translation remain challenging. We describe the methods employed by the participating teams and briefly offer an outlook for NADI.",

keywords = "computation and language, artificial intelligence",

author = "Muhammad Abdul-Mageed and Amr Keleg and AbdelRahim Elmadany and Chiyu Zhang and Injy Hamed and Walid Magdy and Houda Bouamor and Nizar Habash",

year = "2024",

month = aug,

day = "16",

doi = "10.18653/v1/2024.arabicnlp-1.79",

language = "English",

pages = "709--728",

editor = "Nizar Habash and Houda Bouamor and Ramy Eskander and Nadi Tomeh and Farha, {Ibrahim Abu} and Ahmed Abdelali and Samia Touileb and Injy Hamed and Yaser Onaizan and Bashar Alhafni and Wissam Antoun and Salam Khalifa and Hatem Haddad and Imed Zitouni and Badr AlKhamissi and Rawan Almatham and Khalil Mrini",

booktitle = "Proceedings of The Second Arabic Natural Language Processing Conference",

publisher = "Association for Computational Linguistics (ACL)",

edition = "2",

note = "The Second Arabic Natural Language Processing Conference, ArabicNLP 2024 ; Conference date: 16-08-2024 Through 16-08-2024",

url = "https://arabicnlp2024.sigarab.org/",

}

Abdul-Mageed, M, Keleg, A, Elmadany, A, Zhang, C, Hamed, I, Magdy, W, Bouamor, H & Habash, N 2024, NADI 2024: The fifth nuanced Arabic dialect identification shared task. in N Habash, H Bouamor, R Eskander, N Tomeh, IA Farha, A Abdelali, S Touileb, I Hamed, Y Onaizan, B Alhafni, W Antoun, S Khalifa, H Haddad, I Zitouni, B AlKhamissi, R Almatham & K Mrini (eds), Proceedings of The Second Arabic Natural Language Processing Conference. 2 edn, Association for Computational Linguistics (ACL), pp. 709-728, The Second Arabic Natural Language Processing Conference, Bangkok, Thailand, 16/08/24. https://doi.org/10.18653/v1/2024.arabicnlp-1.79

NADI 2024: The fifth nuanced Arabic dialect identification shared task. / Abdul-Mageed, Muhammad ; Keleg, Amr; Elmadany, AbdelRahim et al.
Proceedings of The Second Arabic Natural Language Processing Conference. ed. / Nizar Habash; Houda Bouamor; Ramy Eskander; Nadi Tomeh; Ibrahim Abu Farha; Ahmed Abdelali; Samia Touileb; Injy Hamed; Yaser Onaizan; Bashar Alhafni; Wissam Antoun; Salam Khalifa; Hatem Haddad; Imed Zitouni; Badr AlKhamissi; Rawan Almatham; Khalil Mrini. 2. ed. Association for Computational Linguistics (ACL), 2024. p. 709-728.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - NADI 2024

T2 - The Second Arabic Natural Language Processing Conference

AU - Abdul-Mageed, Muhammad

AU - Keleg, Amr

AU - Elmadany, AbdelRahim

AU - Zhang, Chiyu

AU - Hamed, Injy

AU - Magdy, Walid

AU - Bouamor, Houda

AU - Habash, Nizar

N1 - Conference code: 2

PY - 2024/8/16

Y1 - 2024/8/16

N2 - We describe the findings of the fifth Nuanced Arabic Dialect Identification Shared Task (NADI 2024). NADI's objective is to help advance SoTA Arabic NLP by providing guidance, datasets, modeling opportunities, and standardized evaluation conditions that allow researchers to collaboratively compete on pre-specified tasks. NADI 2024 targeted both dialect identification cast as a multi-label task (Subtask~1), identification of the Arabic level of dialectness (Subtask~2), and dialect-to-MSA machine translation (Subtask~3). A total of 51 unique teams registered for the shared task, of whom 12 teams have participated (with 76 valid submissions during the test phase). Among these, three teams participated in Subtask~1, three in Subtask~2, and eight in Subtask~3. The winning teams achieved 50.57 F\textsubscript{1} on Subtask~1, 0.1403 RMSE for Subtask~2, and 20.44 BLEU in Subtask~3, respectively. Results show that Arabic dialect processing tasks such as dialect identification and machine translation remain challenging. We describe the methods employed by the participating teams and briefly offer an outlook for NADI.

AB - We describe the findings of the fifth Nuanced Arabic Dialect Identification Shared Task (NADI 2024). NADI's objective is to help advance SoTA Arabic NLP by providing guidance, datasets, modeling opportunities, and standardized evaluation conditions that allow researchers to collaboratively compete on pre-specified tasks. NADI 2024 targeted both dialect identification cast as a multi-label task (Subtask~1), identification of the Arabic level of dialectness (Subtask~2), and dialect-to-MSA machine translation (Subtask~3). A total of 51 unique teams registered for the shared task, of whom 12 teams have participated (with 76 valid submissions during the test phase). Among these, three teams participated in Subtask~1, three in Subtask~2, and eight in Subtask~3. The winning teams achieved 50.57 F\textsubscript{1} on Subtask~1, 0.1403 RMSE for Subtask~2, and 20.44 BLEU in Subtask~3, respectively. Results show that Arabic dialect processing tasks such as dialect identification and machine translation remain challenging. We describe the methods employed by the participating teams and briefly offer an outlook for NADI.

KW - computation and language

KW - artificial intelligence

U2 - 10.18653/v1/2024.arabicnlp-1.79

DO - 10.18653/v1/2024.arabicnlp-1.79

M3 - Conference contribution

SP - 709

EP - 728

BT - Proceedings of The Second Arabic Natural Language Processing Conference

A2 - Habash, Nizar

A2 - Bouamor, Houda

A2 - Eskander, Ramy

A2 - Tomeh, Nadi

A2 - Farha, Ibrahim Abu

A2 - Abdelali, Ahmed

A2 - Touileb, Samia

A2 - Hamed, Injy

A2 - Onaizan, Yaser

A2 - Alhafni, Bashar

A2 - Antoun, Wissam

A2 - Khalifa, Salam

A2 - Haddad, Hatem

A2 - Zitouni, Imed

A2 - AlKhamissi, Badr

A2 - Almatham, Rawan

A2 - Mrini, Khalil

PB - Association for Computational Linguistics (ACL)

Y2 - 16 August 2024 through 16 August 2024

ER -

Abdul-Mageed M, Keleg A, Elmadany A, Zhang C, Hamed I, Magdy W et al. NADI 2024: The fifth nuanced Arabic dialect identification shared task. In Habash N, Bouamor H, Eskander R, Tomeh N, Farha IA, Abdelali A, Touileb S, Hamed I, Onaizan Y, Alhafni B, Antoun W, Khalifa S, Haddad H, Zitouni I, AlKhamissi B, Almatham R, Mrini K, editors, Proceedings of The Second Arabic Natural Language Processing Conference. 2 ed. Association for Computational Linguistics (ACL). 2024. p. 709-728 doi: 10.18653/v1/2024.arabicnlp-1.79

NADI 2024: The fifth nuanced Arabic dialect identification shared task

Abstract / Description of output

Conference

Keywords / Materials (for Non-textual outputs)

Access to Document

Fingerprint

Cite this