Doctors Warn Against Relying on AI for Health Guidance

Family physicians express serious concerns regarding the use of artificial intelligence, particularly chatbots like ChatGPT, for medical advice. Dr. Danielle Martin, chair of the University of Toronto’s department of family and community medicine, firmly states, “I don’t think patients should use ChatGPT for medical advice. Period.” This caution comes as approximately 6.5 million Canadians currently lack a primary care provider, leaving many to seek health information from AI.

Dr. Martin’s apprehensions are echoed by various medical organizations, including the Ontario Medical Association, as well as research from institutions like the Sunnybrook Health Science Centre. These groups warn that relying on AI for health advice could lead to misinterpretations of medical information, especially given a 2025 study that highlighted significant biases in popular chatbots, which may overgeneralize scientific conclusions.

Understanding AI’s Limitations in Medical Advice

Dr. Martin emphasizes that while AI can retrieve extensive information, it often lacks the necessary context for medical inquiries. For instance, a patient asking, “I have a red rash on my leg, what could it be?” might receive a deluge of information that is difficult to process. She notes, “My concern is that the average busy person isn’t going to be able to read and process all of that information.”

Instead of seeking direct medical advice from a chatbot, Dr. Martin encourages patients to ask for guidance on finding reliable sources. For example, instead of asking, “Should I get this year’s flu shot?” a more productive question would be, “What are the most reliable websites to learn more about this year’s flu shot?”

Patients are particularly cautioned against following treatment recommendations from AI. Dr. Martin advises that before purchasing any creams or medications suggested by an AI, individuals should consult a healthcare professional, especially since symptoms like rashes can stem from various causes.

AI’s Role in Patient Care

Despite the concerns, Dr. Onil Bhattacharrya, director of Women’s College Hospital’s Institute for Health System Solutions and Virtual Care, sees potential in AI as a tool to democratize access to medical knowledge. He indicates that chatbots could encourage patients to seek care rather than deter them. “Generally, the tools are … slightly risk-averse, so they might push you to more likely seek care than not,” he remarks.

Dr. Bhattacharrya also points out the challenges patients face in evaluating the reliability of AI-generated medical advice. Unlike healthcare professionals, patients may lack the training to critically appraise the information provided by chatbots. He highlights that while AI may suggest treatment options popular in some countries, they may not be applicable in Canada due to differences in medical practices and regulations.

While Dr. Martin acknowledges that AI can sometimes outperform human physicians in recalling a comprehensive list of conditions associated with symptoms, she insists that the nuanced judgment of a medical professional is irreplaceable. “On a good day, we’re best at identifying the things that are common and the things that are dangerous,” she explains.

Both doctors recognize AI’s potential to aid patients, particularly those with chronic conditions seeking simplified health information. However, Dr. Bhattacharrya warns against using AI for vague symptoms, as chatbots may not effectively communicate the need for ongoing monitoring or professional evaluation.

The conversation around the integration of AI into healthcare continues to evolve. As technology advances, physicians are tasked with ensuring that patients understand both the capabilities and limitations of artificial intelligence in medical contexts.