Full Breakdown
OpenAI Clarifies ChatGPT's Role in Health and Legal Information
11/6/2025, 1:31:59 PM
OpenAI's Policy Update and Clarification
OpenAI has recently addressed rumors circulating on social media regarding a supposed ban on ChatGPT providing health and legal information. The confusion stemmed from a policy update that consolidated previous guidelines into a single document. Karan Singhal, OpenAI’s Head of Health AI, clarified on Twitter that the model's behavior remains unchanged and emphasized that ChatGPT has never been a substitute for professional advice. He stated, “Not true. Despite speculation, this is not a new change to our terms. ChatGPT has never been a substitute for professional advice, but it will continue to be a great resource to help people understand legal and health information.”
The Line Between Legal Advice and Information
The updated policy, effective October 29, 2023, reiterates that users should not rely on OpenAI's tools for tailored advice requiring a license, such as legal or medical advice, without the involvement of a licensed professional. This has raised questions among legal professionals about the distinction between legal advice and legal information, particularly as more individuals turn to generative AI for assistance with legal issues. Legal experts have noted that while OpenAI's update does not change how ChatGPT operates, it highlights the need for clearer regulations regarding AI's role in providing legal services.
Concerns Over AI in Medical Contexts
The use of AI for medical inquiries has also sparked concern. Reports indicate that individuals have faced serious health consequences after relying on AI-generated advice. For instance, a Moroccan man attempted a self-treatment for a growth he believed to be a hemorrhoid, which resulted in a hospital visit for a misdiagnosed genital wart. Another case involved a 60-year-old man who suffered bromide poisoning after following ChatGPT's suggestion to replace table salt with sodium bromide. These incidents underscore the potential dangers of using AI for self-diagnosis, as AI lacks the ability to assess urgency or emotional states.
Criticism and Calls for Regulation
Critics argue that the current landscape of AI-generated health and legal information is fraught with risks. Dr. Darren Lebl from New York’s Hospital for Special Surgery noted that many patients challenge their doctors with AI-sourced information, some of which is fabricated. Additionally, there are calls for regulatory bodies to address the implications of AI in these fields. Legal expert Doble remarked that regulators have been largely silent on the issue, despite the growing use of AI tools like ChatGPT in providing legal services.
Verbatim Quotes
- “Not true. Despite speculation, this is not a new change to our terms. Model behavior remains unchanged. ChatGPT has never been a substitute for professional advice, but it will continue to be a great resource to help people understand legal and health information.” — Karan Singhal, Head of Health AI, OpenAI
- “I’m not saying that there needs to be this wholesale crackdown on the use of ChatGPT… but regulators can’t be silent,” — Doble, Legal Expert
Conclusion
OpenAI's recent clarification regarding ChatGPT's capabilities highlights the ongoing debate about the role of AI in providing health and legal information. As users increasingly turn to these tools, the need for clear guidelines and regulatory oversight becomes more pressing to mitigate potential risks associated with misinformation.
