Surgeons Raise Concerns Over AI Surgical Tools’ Safety Risks

AI-powered surgical tools are increasingly present in operating rooms, raising significant safety concerns among medical professionals. While these devices are designed to assist surgeons rather than perform surgery autonomously, recent investigations and a series of lawsuits have prompted a reevaluation of their role in healthcare.

According to an investigation by Reuters, the number of AI-integrated medical devices authorized by the FDA has surged to at least 1,357, doubling the count from 2022. Among these, the TruDi Navigation System, developed by Johnson & Johnson, stands out as a key tool that uses machine learning to aid ear, nose, and throat specialists during procedures. Other AI-assisted devices are employed in various surgical applications, particularly in enhancing visualization during laparoscopic surgeries. Traditional methods present challenges such as smoke obstructing the surgical field and two-dimensional images complicating depth perception. AI tools aim to eliminate these issues by offering clearer views of the operative field.

Despite their potential benefits, there has been a notable increase in allegations and lawsuits claiming that these tools have caused patient harm. Reports indicate that the FDA has received unconfirmed notifications of at least 100 malfunctions and adverse events associated with the TruDi system. In several incidents, the AI allegedly misinformed surgeons regarding the positioning of instruments during procedures, leading to serious complications. For instance, one patient experienced cerebrospinal fluid leakage, while another suffered a punctured skull base.

In more severe cases, patients have reportedly suffered strokes due to injuries to major arteries, which plaintiffs attribute to misleading information from the TruDi’s AI system. One claim detailed how the AI’s errors led to a surgeon injuring a carotid artery, resulting in a blood clot and subsequent stroke.

FDA reports on device malfunctions do not determine the specific causes of medical incidents, leaving uncertainty around the role of AI in these cases. The TruDi is not the only AI-assisted medical device facing scrutiny. The Sonio Detect, a machine that analyzes prenatal images, has been accused of misidentifying fetal structures due to a faulty algorithm. Similarly, Medtronic has faced allegations regarding its AI-assisted heart monitors, which reportedly failed to detect abnormal rhythms or pauses in patients.

Research published in JAMA Health Forum indicates that at least 60 AI-assisted medical devices have been linked to 182 product recalls by the FDA. Alarmingly, around 43% of these recalls occurred within the first year following the devices’ FDA approval. This trend suggests that the FDA’s approval process may not adequately address early performance failures of AI technologies.

Despite these challenges, there is optimism that improvements can be made. Strengthening premarket clinical testing requirements and enhancing postmarket surveillance measures could help identify and mitigate device errors more effectively. As the use of AI in surgery continues to evolve, addressing these safety concerns will be crucial for ensuring patient well-being and maintaining trust in these advanced technologies.