Coverage of FDAs AI/ML Medical Devices Workshop – Part 3: A Summary of the Panel Discussions – JD Supra

In the weeks leading up to FDAs October 14, 2021 Transparency of AI/ML Enabled Medical Devices Workshop (Workshop), we took a brief look at the history of FDAs regulation of medical device software and the agencys more recent efforts in regulating digital health. In this post, we will provide an overview of the topics discussed at the Workshop and our impressions of the agencys likely next steps.

Stakeholders participating in the Workshop discussed what form(s) product labeling might take, and whether something analogous to a nutrition label would be helpful in other words, a short-form, uniform label formatted to present essential, easily understandable information about the AI/ML-enabled devices accuracy, fairness, generalization, transparency, and robustness, among other things). Patients discussed the need to have a brief overview with critical information, which might look more like a nutrition label, but they also mentioned that more information should be made readily available to patients and their providers, similar to a more lengthy package insert for prescription drugs. Stakeholders also discussed the idea that information about AI/ML-enabled devices provided to a health care provider and a patient should be different and appropriately tailored and that the opportunity to access real-time data about the technologys accuracy and performance could significantly enhance transparency.

Topics of significant discussion amongst the stakeholders during the day-long event were concerns about data quality, bias, and health equity. Bias is a concern because AI/ML is so heavily data-driven and can result in inherent biases depending on the data set that is used to develop the technology. As a result, the stakeholders discussed the importance of data sets being representative of the intended patient population, and they agreed that health equity is a key goal to build into those data collection efforts as well. The group discussed the need for evaluations of sex-specific data, race and ethnicity data, and age, disabilities, and comorbidities in clinical testing and human factors analyses in order to improve consistency and transparency regarding safety, efficacy and usability for various groups.

Another topic of interest to Workshop participants was how to provide transparency when companies are using proprietary software, and whether insisting on open source coding so patients and health care providers can see the algorithms used would make a difference. In general, there seemed to be more interest in understanding how the algorithm was trained, how it works, and how accurate it is within specific patient populations, rather than having access to the actual algorithm. However, it seems clear that open source coding is something that FDA is considering with respect to transparency.

Stakeholders also discussed the need for design controls and the need for understanding users and incorporating human factors during the design and validation process for AI/ML-enabled medical devices. They debated the need for an intuitive user interface, which can benefit from early user involvement in the design process, as well as the potential for using predetermined change control plans. Such a predetermined change control plan could include the rationale for the update, a description of change in product claims, and a description of any changes to the software and its instructions for use. Finally, the stakeholders acknowledged that machine learning will be more challenging and likely require more of an ongoing validation and reporting process compared to artificial intelligence with locked algorithms.

Patients and patient advocates continue to voice concerns about the potential for clinical and personal data to be used against patients. With the vast amount of information available about individuals from various sources, there are legitimate concerns about the use and disclosure of de-identified data sets due to the potential for re-identification. There are also legitimate concerns about the potential harm to patients from false positives and incidental findings, for example, misdiagnoses and denial of insurance coverage. Some also question whether patients are given sufficient information about what laws protect their personal and health information and what precautions will be used to protect their privacy before they agree to use the technology. Finally, there seems to be some consensus that some level of patient consent should be required before an AI/ML-enabled device may collect a patients data, and there is some question as to whether clicking I accept on a data privacy policy should be sufficient.

In closing, the recent Workshop highlighted an overarching theme that transparency means communicating appropriate information throughout the product lifecycle at the right times and taking into account different contextual factors, and FDA is seeking comments to elucidate how to accomplish such communication effectively. In particular, FDA seems to be interested in gathering perspectives from stakeholders on how to provide patient-centered transparency with the goal of communicating the risks and benefits of the technology, how to effectively and safely use it, and any information necessary for monitoring the devices performance. Further, FDA is interested in methods to address health equity issues and to communicate the right information at the right time. Specifically, views on information to include on product labels and whether use of expanded media such as videos would be helpful to the agency. Additionally, FDA is seeking input on how to incorporate user participation in design, and how to best tailor its regulatory approach to AI/ML.

We encourage all interested parties, as FDA officials did at the close of the Workshop, to submit comments on the topic of AI/ML-enabled medical device transparency to the docket (FDA-2019-N-1185) by November 15, 2021.

[View source.]

Read the original:

Coverage of FDAs AI/ML Medical Devices Workshop - Part 3: A Summary of the Panel Discussions - JD Supra