TY - CHAP
T1 - EU non-discrimination law in the era of artificial intelligence
T2 - Mapping the challenges of algorithmic discrimination
AU - Xenidis, Raphaele
AU - Senden, Linda
N1 - To be published 1/7/2020
PY - 2020/7/1
Y1 - 2020/7/1
N2 - While most studies on the topic of AI, algorithms and bias have been conducted from the point of view of ‘fairness’ in the field of information technologies and computer science, this chapter explores the question of algorithmic discrimination – a category that does not neatly overlap with algorithmic bias – from the specific perspective of non-discrimination law. In particular and by contrast to the majority of current research on the question of algorithms and discrimination, which focuses on the United States context, this chapter takes EU non-discrimination law as its object of enquiry. We pose the question of the resilience of the general principle of non-discrimination, that is, the capacity for EU equality law to respond effectively to the specific challenges posed by algorithmic discrimination. Because EU law represents an overarching framework and sets minimum safeguards for the protection against discrimination at national level in EU Member States, it is important to test out the protection against the risks posed by the pervasive and increasing use of AI techniques in everyday life applications which this framework allows for. This chapter therefore maps the challenges arising from artificial intelligence for equality and non-discrimination, which are both a general principle and a fundamental right in EU law. First, we identify the specific risks of discrimination that AI-based decision-making, and in particular machine-learning algorithms, pose. Second, we review how EU non-discrimination law can capture algorithmic discrimination in terms of its substantive scope. Third, we conduct this review from a conceptual perspective, mapping the friction points that emerge from the perspective of the EU concepts of direct and indirect discrimination, as developed by the Court of Justice of the European Union (CJEU). In the final step, we identify the core challenges algorithmic discrimination poses at the enforcement level and propose potential ways forward.
AB - While most studies on the topic of AI, algorithms and bias have been conducted from the point of view of ‘fairness’ in the field of information technologies and computer science, this chapter explores the question of algorithmic discrimination – a category that does not neatly overlap with algorithmic bias – from the specific perspective of non-discrimination law. In particular and by contrast to the majority of current research on the question of algorithms and discrimination, which focuses on the United States context, this chapter takes EU non-discrimination law as its object of enquiry. We pose the question of the resilience of the general principle of non-discrimination, that is, the capacity for EU equality law to respond effectively to the specific challenges posed by algorithmic discrimination. Because EU law represents an overarching framework and sets minimum safeguards for the protection against discrimination at national level in EU Member States, it is important to test out the protection against the risks posed by the pervasive and increasing use of AI techniques in everyday life applications which this framework allows for. This chapter therefore maps the challenges arising from artificial intelligence for equality and non-discrimination, which are both a general principle and a fundamental right in EU law. First, we identify the specific risks of discrimination that AI-based decision-making, and in particular machine-learning algorithms, pose. Second, we review how EU non-discrimination law can capture algorithmic discrimination in terms of its substantive scope. Third, we conduct this review from a conceptual perspective, mapping the friction points that emerge from the perspective of the EU concepts of direct and indirect discrimination, as developed by the Court of Justice of the European Union (CJEU). In the final step, we identify the core challenges algorithmic discrimination poses at the enforcement level and propose potential ways forward.
KW - discrimination
KW - Artificial intelligence
KW - equality
KW - algorithms
KW - EU Law
UR - https://lrus.wolterskluwer.com/store/product/general-principles-of-eu-law-and-the-eu-digital-order/
M3 - Chapter (peer-reviewed)
SN - 9789403511658
T3 - European Monographs
SP - 151
EP - 182
BT - General Principles of EU Law and the EU Digital Order
A2 - Bernitz, Ulf
A2 - Groussot, Xavier
A2 - Paju, Jaan
A2 - de Vries, Sybe A
PB - Wolters Kluwer
ER -