Key Takeaways
Health in ChatGPT is coming to U.S. users
- ChatGPT now integrates with Apple Health, accessing medical records, sleep, activity data with user permission
- A lawsuit filed the day before alleges ChatGPT's medical advice contributed to a near-fatal pulmonary embolism
- Studies show AI chatbots fail at early differential diagnosis in over 80% of cases
OpenAI launched Health in ChatGPT on July 24, allowing users to connect Apple Health data and medical records to the chatbot. The timing is striking: one day earlier, a Florida man sued the company in San Francisco Superior Court, claiming ChatGPT's medical advice nearly killed him by discouraging him from seeking care for a pulmonary embolism.
What does ChatGPT's health integration actually do?
The feature connects ChatGPT to Apple's Health app on iOS. Users can choose to share medications, lab results, recent doctor visits, sleep patterns, activity data, and other health information stored in the app. OpenAI says this gives ChatGPT "additional context for health-related conversations, allowing it to provide more personalized responses."
OpenAI claims it tested a dedicated Health experience within ChatGPT earlier this year. Users ignored it. More than 70 percent of health-related conversations happened outside that dedicated space, so the company decided to integrate health data into general ChatGPT chats instead.
The company says it worked with hundreds of physicians to test the feature for performance and safety. It also states it won't use connected health data to train foundation models or serve ads.
The lawsuit: ChatGPT advice allegedly delayed care for pulmonary embolism
The plaintiff claims ChatGPT gave him "extremely dangerous medical recommendations" that repeatedly reassured him his symptoms were not serious and urged him to stay home. His pulmonary embolism worsened. He was later hospitalized and says he now faces years of intensive physical and psychological recovery.
An OpenAI spokesperson told The New York Times that ChatGPT's terms of service make clear it is not intended for medical diagnosis or treatment. The spokesperson added that the company's models have improved since the incident at the heart of the lawsuit.
“ChatGPT is not a doctor and should never be used as a substitute for medical care, diagnosis, or treatment. Treating chatbots as the whole story behind people's medical decisions or outcomes oversimplifies a much bigger challenge.”
— OpenAI spokesperson
Will health records access make ChatGPT safer?
OpenAI's announcement suggests that access to medical records could help prevent bad advice. In the lawsuit case, the plaintiff's data might have included prior treatment indicating increased risk for pulmonary embolism. But having more data doesn't fix the core problem: ChatGPT can still be wrong.
Recent studies paint a grim picture of AI in healthcare. One study found AI chatbots were no better at helping people make health decisions than conventional online resources, including search engines. Another found LLMs failed at early differential diagnosis in more than 80 percent of cases.
In Canada, the Auditor General of Ontario found that AI note-taking systems used by doctors routinely introduced medication errors into patient notes, omitted critical details, inserted incorrect information, and hallucinated things that neither patients nor clinicians discussed during appointments.
What should IT leaders consider about AI health tools?
For organizations evaluating AI tools in healthcare adjacent workflows, this launch raises familiar questions about liability, data governance, and user behavior. OpenAI disclaims medical use in its terms of service, but users clearly ignore those boundaries. Over 70 percent already conducted health conversations outside the dedicated space.
The integration with Apple Health means ChatGPT can now access some of the most sensitive personal data that exists. OpenAI says it won't use this data for training. But the lawsuit demonstrates that even without training on user data, the chatbot's outputs can cause real harm when users treat it as a medical authority.
One in seven Brits have reportedly swapped their GP for ChatGPT, according to a recent study. The demand for AI health advice is real. The question is whether giving it more data makes it safer, or just more convincing when it's wrong.
Logicity's Take
This launch positions OpenAI ahead of competitors like Google's Gemini and Anthropic's Claude in consumer health AI, but the timing is a PR disaster. For enterprise IT teams, the takeaway is clear: any AI deployment touching health data needs ironclad guardrails, not just disclaimers buried in terms of service. The lawsuit will test whether those disclaimers hold up when users predictably ignore them. Healthcare organizations already using tools like Epic's AI integrations or Nuance DAX should watch this closely. OpenAI is betting users want AI health advice badly enough to share their medical records. Whether regulators agree is another matter.
Privacy claims versus user reality
OpenAI's privacy assurances, no training on health data, no ads, address obvious concerns. But they miss the subtler risk. Users sharing medical records with a general-purpose chatbot are mixing sensitive health data with every other conversation they have. That expands the attack surface for prompt injection, social engineering, and data exposure through conversation history.
Apple Health already aggregates data from iPhones, Apple Watches, and third-party apps. Adding ChatGPT to that ecosystem creates another node where breaches could expose deeply personal information. OpenAI has suffered credential leaks before. Health data deserves a higher bar.
Another example of AI expanding into sensitive sectors like education
Frequently Asked Questions
Can ChatGPT access my medical records without permission?
No. Users must explicitly opt in and choose which data to share through Apple Health integration. OpenAI states it won't use connected health data for training or advertising.
Is ChatGPT approved for medical diagnosis?
No. OpenAI's terms of service explicitly state ChatGPT is not intended for medical diagnosis or treatment. The company warns users it can make mistakes and should not replace qualified medical professionals.
What health data can ChatGPT access through Apple Health?
Users can share medications, lab results, recent doctor visits, sleep patterns, activity data, allergies, and other health information stored in Apple's Health app.
Has anyone been harmed by following ChatGPT's medical advice?
A lawsuit filed July 23, 2026 alleges ChatGPT's advice contributed to a near-fatal pulmonary embolism by repeatedly reassuring the user his symptoms were not serious.
How accurate is AI at medical diagnosis?
Studies show AI chatbots perform no better than conventional online resources for health decisions. One study found LLMs failed at early differential diagnosis in over 80% of cases.
Need Help Implementing This?
If your organization is evaluating AI tools for healthcare or sensitive data applications, Logicity offers consulting on enterprise AI governance, security assessments, and vendor evaluation. Contact us to discuss your implementation strategy.
Source: www.theregister.com
Huma Shazia
Senior AI & Tech Writer
Produced with AI assistance and reviewed by the Logicity editorial team. Learn more in our Editorial Policy.
