Trustworthy Artificial Intelligence in Healthcare: a proposed framework

St John Lynch, Niamh and Loughran, Roisin and mchugh, martin, Martin and McCaffrey, Fergal (2025) Trustworthy Artificial Intelligence in Healthcare: a proposed framework. In: EuroSPI'25, 16 Sept 2025, Riga, Latvia. (In Press)

Microsoft Word (Trustworthy AI in Healthcare: a proposed framework) - Accepted Version Download (943kB)

Abstract

Trustworthy Artificial Intelligence (TwAI) is not sufficiently defined within healthcare to enable legal manufacturers and developers to identify and operationalise, with a high degree of assurance, the General Safety and Performance Requirements. This includes patients’ fundamental rights which are necessary to meet European regulatory requirements and stakeholder expectations. Medical Device Software developers are tasked with identifying appropriate performance measures for robustness of Artificial Intelligence-enabled Medical Devices based on the use case and risks identified by the development team. Risk identification is heavily reliant on the adequacy of their risk management process and the competency of personnel. As medical device software defects continue to be identified in the post-market phase, further research and guidance is necessary. Medical device manufacturers have reported a lack of understanding and harmonisation of the requirements that make up TwAI in healthcare, starting with ethical requirements. With standards development still in progress, research is necessary to ensure a common framework is applied, having appropriate development processes, methods, and measures for delivery of TwAI in healthcare. Therefore, we conducted a review of trust for two reasons: 1) to attempt to gain a collective understanding of TwAI in healthcare; 2) to propose a framework that considers the regulatory landscape for Artificial Intelligence-enabled Medical Devices that is sufficiently detailed to move beyond theoretical concepts. This research brings together the state of the art for artificial intelligence in healthcare for a harmonised approach and extends the literature by presenting a proposed framework to be operationalised by legal manufacturers and developers who place medical devices on the market for clinical use.

Item Type:	Conference or Workshop Item (Paper)
Uncontrolled Keywords:	Artificial Intelligence Medical Devices
Subjects:	Engineering Social Sciences > Law Computer Science > Computer Software
Research Centres:	Regulated Software Research Centre
Depositing User:	Niamh StJohnLynch
Date Deposited:	06 Aug 2025 08:44
Last Modified:	06 Aug 2025 08:44
License:	Creative Commons: Attribution-Noncommercial-Share Alike 4.0
URI:	https://eprints.dkit.ie/id/eprint/935

Actions (login required)

View Item

Downloads