Legal provocations for HCI in the design and development of trustworthy autonomous systems

Lachlan D. Urquhart; Glenn McGarry; Andy  Crabtree

doi:10.1145/3546155.3546690

Legal provocations for HCI in the design and development of trustworthy autonomous systems

Lachlan D. Urquhart, Glenn McGarry, Andy Crabtree

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract / Description of output

We propose a series of legal provocations emerging from the proposed European Union Artificial Intelligence Act 2021 (AIA) and explore how they open up new possibilities for HCI in the design and development of trustworthy autonomous systems. The AIA continues the‘by design’ trend seen in recent EU regulation of emerging technologies. The AIA targets AI developments that pose risks to society and citizens’ fundamental rights, introducing mandatory design and development requirements for high-risk AI systems (HRAIS). These requirements regulate different stages of the AI development cycle including ensuring data quality and governance strategies, mandating testing of systems, ensuring appropriate risk management, designing for human oversight, and creating technical documentation. These requirements open up new opportunities for HCI that reach beyond established concerns with the ethics and explainability of AI and situate AI development in human-centered processes and methods of design to enable compliance with regulation and foster societal trust in AI.

Original language	English
Title of host publication	Proceedings of the 12th Nordic Conference on Human-Computer Interaction (NordiCHI’22)
Subtitle of host publication	Aarhus, Denmark 8th – 12th October, 2022
Publisher	ACM
Pages	1-12
Number of pages	12
ISBN (Print)	9781450396998
DOIs	https://doi.org/10.1145/3546155.3546690
Publication status	E-pub ahead of print - 8 Oct 2022

Keywords / Materials (for Non-textual outputs)

European Union AI Act (AIA)
trustworthy AI
mandatory design and development requirements

Access to Document

10.1145/3546155.3546690

UrquhartEtalNORDICHI2022LegalProvocationsForHCIAccepted author manuscript, 575 KB

Cite this

Urquhart, L. D., McGarry, G., & Crabtree, A. (2022). Legal provocations for HCI in the design and development of trustworthy autonomous systems. In Proceedings of the 12th Nordic Conference on Human-Computer Interaction (NordiCHI’22): Aarhus, Denmark 8th – 12th October, 2022 (pp. 1-12). Article 75 ACM. Advance online publication. https://doi.org/10.1145/3546155.3546690

@inproceedings{7f385bf92d6345d0ba70749cc7e95857,

title = "Legal provocations for HCI in the design and development of trustworthy autonomous systems",

abstract = "We propose a series of legal provocations emerging from the proposed European Union Artificial Intelligence Act 2021 (AIA) and explore how they open up new possibilities for HCI in the design and development of trustworthy autonomous systems. The AIA continues the{\textquoteleft}by design{\textquoteright} trend seen in recent EU regulation of emerging technologies. The AIA targets AI developments that pose risks to society and citizens{\textquoteright} fundamental rights, introducing mandatory design and development requirements for high-risk AI systems (HRAIS). These requirements regulate different stages of the AI development cycle including ensuring data quality and governance strategies, mandating testing of systems, ensuring appropriate risk management, designing for human oversight, and creating technical documentation. These requirements open up new opportunities for HCI that reach beyond established concerns with the ethics and explainability of AI and situate AI development in human-centered processes and methods of design to enable compliance with regulation and foster societal trust in AI. ",

keywords = "European Union AI Act (AIA), trustworthy AI, mandatory design and development requirements",

author = "Urquhart, {Lachlan D.} and Glenn McGarry and Andy Crabtree",

note = "Funding Information: This work was supported by the UK Engineering and Physical Sciences Research Council [grant numbers EP/V026607/1, EP/T022493/1] and UK Economic and Social Research Council [grant number ES/T00696X/1]. Publisher Copyright: {\textcopyright} 2022 ACM.",

year = "2022",

month = oct,

day = "8",

doi = "10.1145/3546155.3546690",

language = "English",

isbn = "9781450396998",

pages = "1--12",

booktitle = "Proceedings of the 12th Nordic Conference on Human-Computer Interaction (NordiCHI{\textquoteright}22)",

publisher = "ACM",

}

Legal provocations for HCI in the design and development of trustworthy autonomous systems. / Urquhart, Lachlan D.; McGarry, Glenn; Crabtree, Andy .
Proceedings of the 12th Nordic Conference on Human-Computer Interaction (NordiCHI’22): Aarhus, Denmark 8th – 12th October, 2022. ACM, 2022. p. 1-12 75.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Legal provocations for HCI in the design and development of trustworthy autonomous systems

AU - Urquhart, Lachlan D.

AU - McGarry, Glenn

AU - Crabtree, Andy

N1 - Funding Information: This work was supported by the UK Engineering and Physical Sciences Research Council [grant numbers EP/V026607/1, EP/T022493/1] and UK Economic and Social Research Council [grant number ES/T00696X/1]. Publisher Copyright: © 2022 ACM.

PY - 2022/10/8

Y1 - 2022/10/8

N2 - We propose a series of legal provocations emerging from the proposed European Union Artificial Intelligence Act 2021 (AIA) and explore how they open up new possibilities for HCI in the design and development of trustworthy autonomous systems. The AIA continues the‘by design’ trend seen in recent EU regulation of emerging technologies. The AIA targets AI developments that pose risks to society and citizens’ fundamental rights, introducing mandatory design and development requirements for high-risk AI systems (HRAIS). These requirements regulate different stages of the AI development cycle including ensuring data quality and governance strategies, mandating testing of systems, ensuring appropriate risk management, designing for human oversight, and creating technical documentation. These requirements open up new opportunities for HCI that reach beyond established concerns with the ethics and explainability of AI and situate AI development in human-centered processes and methods of design to enable compliance with regulation and foster societal trust in AI.

AB - We propose a series of legal provocations emerging from the proposed European Union Artificial Intelligence Act 2021 (AIA) and explore how they open up new possibilities for HCI in the design and development of trustworthy autonomous systems. The AIA continues the‘by design’ trend seen in recent EU regulation of emerging technologies. The AIA targets AI developments that pose risks to society and citizens’ fundamental rights, introducing mandatory design and development requirements for high-risk AI systems (HRAIS). These requirements regulate different stages of the AI development cycle including ensuring data quality and governance strategies, mandating testing of systems, ensuring appropriate risk management, designing for human oversight, and creating technical documentation. These requirements open up new opportunities for HCI that reach beyond established concerns with the ethics and explainability of AI and situate AI development in human-centered processes and methods of design to enable compliance with regulation and foster societal trust in AI.

KW - European Union AI Act (AIA)

KW - trustworthy AI

KW - mandatory design and development requirements

UR - https://dl.acm.org/doi/proceedings/10.1145/3546155

UR - https://conferences.au.dk/nordichi2022

U2 - 10.1145/3546155.3546690

DO - 10.1145/3546155.3546690

M3 - Conference contribution

SN - 9781450396998

SP - 1

EP - 12

BT - Proceedings of the 12th Nordic Conference on Human-Computer Interaction (NordiCHI’22)

PB - ACM

ER -

Legal provocations for HCI in the design and development of trustworthy autonomous systems

Abstract / Description of output

Keywords / Materials (for Non-textual outputs)

Access to Document

Other files and links

Fingerprint

Cite this