A mixed methods formative evaluation of the United Kingdom National Health Service Artificial Intelligence Lab

Kathrin Cresswell; Robin Williams; Sheena Dungey; Stuart Anderson; Miguel O. Bernabeu; Hajar Mozaffar; Xiao Yang; Varun Sai; Sara Bea; Sally Eason

doi:10.1038/s41746-025-01805-w

A mixed methods formative evaluation of the United Kingdom National Health Service Artificial Intelligence Lab

Kathrin Cresswell^*
, Robin Williams
, Sheena Dungey
, Stuart Anderson
, Miguel O. Bernabeu
, Hajar Mozaffar
, Xiao Yang
, Varun Sai
, Sara Bea
, Sally Eason

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

Abstract

Internationally, health systems are investing in Artificial Intelligence (AI) to improve safety, quality, and efficiency, yet many efforts remain localised and do not progress beyond early development stages. In 2019, National Health Service (NHS) England and the Department of Health and Social Care launched the AI Lab to accelerate safe AI adoption. We conducted a mixed-methods evaluation of the AI Lab, analysing 1021 documents and 85 stakeholder interviews. The AI Lab made important contributions to national AI policy, regulation, and capability building, and positioned the United Kingdom as a global leader in AI deployment for health. Despite progress, implementation and scaling were hindered by shifting objectives, limited capacity, and systemic misalignment with service needs. Some AI technologies demonstrated high return on investment and improved clinical processes. Lessons from the AI Lab highlight critical socio-organisational factors, gaps in scaling support, and the need for sustained coordination to realise the long-term benefits of AI in health and social care systems.

Original language	English
Article number	448
Pages (from-to)	1-19
Number of pages	19
Journal	npj Digital Medicine
Volume	8
Issue number	1
Early online date	17 Jul 2025
DOIs	https://doi.org/10.1038/s41746-025-01805-w
Publication status	Published - Dec 2025

Access to Document

10.1038/s41746-025-01805-wLicence: Creative Commons: Attribution-NonCommercial-NoDerivatives (CC BY-NC-ND)

CresswellEtal2025NPJDMAMixedMethodsFormativeEvaluationFinal published version, 940 KBLicence: Creative Commons: Attribution-NonCommercial-NoDerivatives (CC BY-NC-ND)

Cite this

@article{a514b10d32b84524bdcbb1ed7305cb36,

title = "A mixed methods formative evaluation of the United Kingdom National Health Service Artificial Intelligence Lab",

abstract = "Internationally, health systems are investing in Artificial Intelligence (AI) to improve safety, quality, and efficiency, yet many efforts remain localised and do not progress beyond early development stages. In 2019, National Health Service (NHS) England and the Department of Health and Social Care launched the AI Lab to accelerate safe AI adoption. We conducted a mixed-methods evaluation of the AI Lab, analysing 1021 documents and 85 stakeholder interviews. The AI Lab made important contributions to national AI policy, regulation, and capability building, and positioned the United Kingdom as a global leader in AI deployment for health. Despite progress, implementation and scaling were hindered by shifting objectives, limited capacity, and systemic misalignment with service needs. Some AI technologies demonstrated high return on investment and improved clinical processes. Lessons from the AI Lab highlight critical socio-organisational factors, gaps in scaling support, and the need for sustained coordination to realise the long-term benefits of AI in health and social care systems.",

author = "Kathrin Cresswell and Robin Williams and Sheena Dungey and Stuart Anderson and Bernabeu, \{Miguel O.\} and Hajar Mozaffar and Xiao Yang and Varun Sai and Sara Bea and Sally Eason",

year = "2025",

month = dec,

doi = "10.1038/s41746-025-01805-w",

language = "English",

volume = "8",

pages = "1--19",

journal = "npj Digital Medicine",

issn = "2398-6352",

publisher = "Nature Publishing Group",

number = "1",

}

TY - JOUR

T1 - A mixed methods formative evaluation of the United Kingdom National Health Service Artificial Intelligence Lab

AU - Cresswell, Kathrin

AU - Williams, Robin

AU - Dungey, Sheena

AU - Anderson, Stuart

AU - Bernabeu, Miguel O.

AU - Mozaffar, Hajar

AU - Yang, Xiao

AU - Sai, Varun

AU - Bea, Sara

AU - Eason, Sally

PY - 2025/12

Y1 - 2025/12

N2 - Internationally, health systems are investing in Artificial Intelligence (AI) to improve safety, quality, and efficiency, yet many efforts remain localised and do not progress beyond early development stages. In 2019, National Health Service (NHS) England and the Department of Health and Social Care launched the AI Lab to accelerate safe AI adoption. We conducted a mixed-methods evaluation of the AI Lab, analysing 1021 documents and 85 stakeholder interviews. The AI Lab made important contributions to national AI policy, regulation, and capability building, and positioned the United Kingdom as a global leader in AI deployment for health. Despite progress, implementation and scaling were hindered by shifting objectives, limited capacity, and systemic misalignment with service needs. Some AI technologies demonstrated high return on investment and improved clinical processes. Lessons from the AI Lab highlight critical socio-organisational factors, gaps in scaling support, and the need for sustained coordination to realise the long-term benefits of AI in health and social care systems.

AB - Internationally, health systems are investing in Artificial Intelligence (AI) to improve safety, quality, and efficiency, yet many efforts remain localised and do not progress beyond early development stages. In 2019, National Health Service (NHS) England and the Department of Health and Social Care launched the AI Lab to accelerate safe AI adoption. We conducted a mixed-methods evaluation of the AI Lab, analysing 1021 documents and 85 stakeholder interviews. The AI Lab made important contributions to national AI policy, regulation, and capability building, and positioned the United Kingdom as a global leader in AI deployment for health. Despite progress, implementation and scaling were hindered by shifting objectives, limited capacity, and systemic misalignment with service needs. Some AI technologies demonstrated high return on investment and improved clinical processes. Lessons from the AI Lab highlight critical socio-organisational factors, gaps in scaling support, and the need for sustained coordination to realise the long-term benefits of AI in health and social care systems.

UR - https://www.scopus.com/pages/publications/105011063591

U2 - 10.1038/s41746-025-01805-w

DO - 10.1038/s41746-025-01805-w

M3 - Article

AN - SCOPUS:105011063591

SN - 2398-6352

VL - 8

SP - 1

EP - 19

JO - npj Digital Medicine

JF - npj Digital Medicine

IS - 1

M1 - 448

ER -

A mixed methods formative evaluation of the United Kingdom National Health Service Artificial Intelligence Lab

Abstract

Access to Document

Other files and links

Fingerprint

Cite this