HateCheck: Functional tests for hate speech detection models

Paul Röttger; Bertram Vidgen; Dong Nguyen; Zeerak Waseem; Helen Margetts; Janet B. Pierrehumbert

doi:10.18653/v1/2021.acl-long.4

HateCheck: Functional tests for hate speech detection models

Paul Röttger, Bertram Vidgen, Dong Nguyen, Zeerak Waseem, Helen Margetts, Janet B. Pierrehumbert

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Original language	English
Title of host publication	Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Publisher	Association for Computational Linguistics
Pages	41-58
Number of pages	18
ISBN (Electronic)	9781954085527
DOIs	https://doi.org/10.18653/v1/2021.acl-long.4
Publication status	Published - 6 Aug 2021
Event	The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing - Bangkok, Thailand Duration: 1 Aug 2021 → 6 Aug 2021 https://2021.aclweb.org/

Publication series

Name	Annual meeting of the Association for Computational Linguistics
Publisher	Association for Computational Linguistics
ISSN (Print)	0736-587X

Conference

Conference	The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing
Abbreviated title	ACL-IJCNLP 2021
Country/Territory	Thailand
City	Bangkok
Period	1/08/21 → 6/08/21
Internet address	https://2021.aclweb.org/

Access to Document

10.18653/v1/2021.acl-long.4Licence: Creative Commons: Attribution (CC-BY)

RottgerEtalACL-IJCNLP2021HateCheckFunctionalTestsFinal published version, 347 KBLicence: Creative Commons: Attribution (CC-BY)

Cite this

Röttger, P., Vidgen, B., Nguyen, D., Waseem, Z., Margetts, H., & Pierrehumbert, J. B. (2021). HateCheck: Functional tests for hate speech detection models. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) (pp. 41-58). (Annual meeting of the Association for Computational Linguistics). Association for Computational Linguistics. https://doi.org/10.18653/v1/2021.acl-long.4

Röttger, Paul ; Vidgen, Bertram ; Nguyen, Dong et al. / HateCheck : Functional tests for hate speech detection models. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Association for Computational Linguistics, 2021. pp. 41-58 (Annual meeting of the Association for Computational Linguistics).

@inproceedings{e6ae6dc6c9c14edf8222aaba6ab8588d,

title = "HateCheck: Functional tests for hate speech detection models",

author = "Paul R{\"o}ttger and Bertram Vidgen and Dong Nguyen and Zeerak Waseem and Helen Margetts and Pierrehumbert, \{Janet B.\}",

year = "2021",

month = aug,

day = "6",

doi = "10.18653/v1/2021.acl-long.4",

language = "English",

series = "Annual meeting of the Association for Computational Linguistics",

publisher = "Association for Computational Linguistics",

pages = "41--58",

booktitle = "Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)",

note = "The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL-IJCNLP 2021 ; Conference date: 01-08-2021 Through 06-08-2021",

url = "https://2021.aclweb.org/",

}

Röttger, P, Vidgen, B, Nguyen, D, Waseem, Z, Margetts, H & Pierrehumbert, JB 2021, HateCheck: Functional tests for hate speech detection models. in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Annual meeting of the Association for Computational Linguistics, Association for Computational Linguistics, pp. 41-58, The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, Bangkok, Thailand, 1/08/21. https://doi.org/10.18653/v1/2021.acl-long.4

HateCheck: Functional tests for hate speech detection models. / Röttger, Paul; Vidgen, Bertram; Nguyen, Dong et al.
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Association for Computational Linguistics, 2021. p. 41-58 (Annual meeting of the Association for Computational Linguistics).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - HateCheck

T2 - The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing

AU - Röttger, Paul

AU - Vidgen, Bertram

AU - Nguyen, Dong

AU - Waseem, Zeerak

AU - Margetts, Helen

AU - Pierrehumbert, Janet B.

PY - 2021/8/6

Y1 - 2021/8/6

U2 - 10.18653/v1/2021.acl-long.4

DO - 10.18653/v1/2021.acl-long.4

M3 - Conference contribution

T3 - Annual meeting of the Association for Computational Linguistics

SP - 41

EP - 58

BT - Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)

PB - Association for Computational Linguistics

Y2 - 1 August 2021 through 6 August 2021

ER -

Röttger P, Vidgen B, Nguyen D, Waseem Z, Margetts H, Pierrehumbert JB. HateCheck: Functional tests for hate speech detection models. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Association for Computational Linguistics. 2021. p. 41-58. (Annual meeting of the Association for Computational Linguistics). doi: 10.18653/v1/2021.acl-long.4