Out of isolation: a white paper for regulators and technology developers that considers how an AI healthcare product will be used as part of the clinical system.
The HF/AI project collaborated with key stakeholders to research and publish a new white paper setting out a human factors perspective on the use of artificial intelligence (AI) applications in healthcare.
AI healthcare tools are often developed without considering how they will be used as part of a complex clinical system. The human factors (HF) approach places emphasis on the interactions between people and the AI tool to inform design of AI that promotes human autonomy through high levels of automation, i.e. human autonomy and machine autonomy.
This project developed guidance in the form of a white paper for regulatory bodies and technology developers on HF in the design and use of AI applications in healthcare settings. The project had two parallel and interacting workstreams:
- Stakeholder engagement - key stakeholders from regulatory bodies helped to identity user needs with respect to HF guidance and provide feedback as the white paper was developed
- Guidance development – the white paper was shaped and developed through participation in the Chartered Institute of Ergonomics and Human Factors (CIEHF) special interest group on Digital Health and AI and existing literature on human factors
Through collaboration with key stakeholders including the Chartered Institute of Ergonomics and Human Factors (CIEHF), the Australian Alliance for AI in Healthcare (AAAiH) and the Society for Health Care Innovation (SHCI) the project team developed a new white paper that promotes systems thinking among those who develop, regulate, procure, and use AI applications in healthcare, and to raise awareness of the role of people using or affected by AI.
The primary vehicle for developing the white paper was the CIEHF Digital Health and AI Special Interest Group (SIG). The white paper was published by CIEHF in September 2021. It outlines eight key HF principles that need to be taken into consideration for the successful design and use of AI in healthcare:
- situation awareness
- automation bias
- explanation and trust
- human-AI teaming
- relationships between staff and patients
- ethical issues
- Sujan, M., Pool, R., and Salmon, P. "Eight human factors and ergonomics principles for healthcare artificial intelligence" in BMJ Health & Care Informatics (January 2022)
- A panel discussion on “The role of HF/E in AI operation and evaluation” was held at the Ergonomics & Human Factors Annual Conference in April 2021
- Dr Mark Sujan (principal investigator) Human Factors Everywhere