Artificial intelligence and machine learning (AI/ML) are increasingly transforming the healthcare sector. From spotting malignant tumours to reading CT scans and mammograms, AI/ML-based technology is faster and more accurate than traditional devices - or even the best doctors. But along with the benefits come new risks and regulatory challenges.
In their latest article Algorithms on regulatory lockdown in medicine recently published in Science, researchers look at the new challenges facing regulators as they navigate the unfamiliar pathways of AI/ML.
They consider the questions: What new risks do we face as AI/ML devices are developed and implemented? How should they be managed? What factors do regulators need to focus on to ensure maximum value at minimal risk?
Until now regulatory bodies like the U.S. Food and Drug Administration (FDA) have approved medical AI/ML-based software with "locked algorithms" - that is algorithms that provide the same result each time and do not change with use. However, a key strength and potential benefit from most AI/ML technology is derived from its ability to evolve as the model learns in response to new data. These "adaptive algorithms", made possible because of AI/ML, create what is in essence a learning healthcare system, in which the boundaries between research and practice are porous.
Given the significant value of this adaptive system, a fundamental question for regulators today is whether authorisation should be limited to the version of technology that was submitted and evaluated as being safe and effective, or whether they permit the marketing of an algorithm where greater value is to be found in the technology's ability to learn and adapt to new conditions.
The authors take an in-depth look at the risks associated with this update problem, considering the specific areas which require focus and ways in which the challenges could be addressed.
The key to strong regulation, they say, is to prioritise continuous risk monitoring.
"To manage the risks, regulators should focus particularly on continuous monitoring and risk assessment, and less on planning for future algorithm changes," say the authors.
As regulators move forward, the authors recommend they develop new processes to continuously monitor, identify, and manage associated risks. They suggest key elements that could help with this, and which may in the future themselves be automated using AI/ML - possibly having AI/ML systems monitoring each other.
While the paper draws largely from the FDA's experience in regulating biomedical technology, the lessons and examples have broad relevance as other countries consider how they shape their associated regulatory architecture. They are also important and relevant for any business that develops AI/ML embedded products and services, from automotive, to insurance, financials, energy, and increasingly many others. Executives in all organisations have a lot to learn about managing new AI/ML risks from how regulators think about them today.
"Our goal is to emphasise the risks that can arise from unanticipated changes in how medical AI/ML systems react or adapt to their environments," say the authors, warning that, "Subtle, often unrecognised parametric updates or new types of data can cause large and costly mistakes."
https://science.sciencemag.org/content/366/6470/1202
Reducing risk in AI and machine learning-based medical technology
- 2,928 views
- Added
Edited
Latest News
The assembly of the human c…
By newseditor
Posted 24 Apr
Wiring of the human neocortex
By newseditor
Posted 24 Apr
Abusive drugs hijack natura…
By newseditor
Posted 23 Apr
Mechanism of action of the…
By newseditor
Posted 23 Apr
Role of fat in rare neurolo…
By newseditor
Posted 23 Apr
Other Top Stories
Inhibiting peripheral serotonin to reduce cancer growth
Read more
A protein interaction landscape of breast cancer
Read more
A new cancer-driving mechanism identified!
Read more
Anti-angiogenesis cancer drug reverses Alzheimer's symptoms in mice
Read more
How DNA repair is affected in cancer
Read more
Protocols
A programmable targeted pro…
By newseditor
Posted 23 Apr
MemPrep, a new technology f…
By newseditor
Posted 08 Apr
A tangible method to assess…
By newseditor
Posted 08 Apr
Stem cell-derived vessels-o…
By newseditor
Posted 06 Apr
Single-cell biclustering fo…
By newseditor
Posted 01 Apr
Publications
Hippocampus-to-amygdala pat…
By newseditor
Posted 24 Apr
Integrative spatial analysi…
By newseditor
Posted 24 Apr
Time-series reconstruction…
By newseditor
Posted 24 Apr
Harnessing gastrointestinal…
By newseditor
Posted 24 Apr
Sex-specific modulation of…
By newseditor
Posted 24 Apr
Presentations
Hydrogels in Drug Delivery
By newseditor
Posted 12 Apr
Lipids
By newseditor
Posted 31 Dec
Cell biology of carbohydrat…
By newseditor
Posted 29 Nov
RNA interference (RNAi)
By newseditor
Posted 23 Oct
RNA structure and functions
By newseditor
Posted 19 Oct
Posters
A chemical biology/modular…
By newseditor
Posted 22 Aug
Single-molecule covalent ma…
By newseditor
Posted 04 Jul
ASCO-2020-HEALTH SERVICES R…
By newseditor
Posted 23 Mar
ASCO-2020-HEAD AND NECK CANCER
By newseditor
Posted 23 Mar
ASCO-2020-GENITOURINARY CAN…
By newseditor
Posted 23 Mar