Can you use ChatGPT or other AI tools with PHI under HIPAA?
Under HIPAA, you may only use an AI tool with Protected Health Information (PHI) if the vendor will sign a Business Associate Agreement (BAA) and you apply the required safeguards. Most consumer AI tools will not sign a BAA, so pasting PHI into a personal ChatGPT or Claude account is a HIPAA violation and a reportable breach risk.
Who it applies to
Covered entities and business associates in US healthcare — providers, payers, and their vendors — handling Protected Health Information.
What it requires
- A Business Associate Agreement (BAA) with any AI vendor that touches PHI.
- Administrative, physical, and technical safeguards (45 CFR §164.308/.312).
- Access controls and audit trails for systems handling PHI.
- Breach-notification readiness if PHI is exposed.
How to comply
- Prohibit PHI in any AI tool that has not signed a BAA.
- Use only AI services that offer a BAA, or de-identify data first.
- Mask PHI on-device before it reaches the AI tool.
- Document safeguards and access controls for your evidence pack.
- Train clinical and ops staff on PHI + AI rules.
See exactly where you stand
Run a free 2-minute AI Exposure assessment — your risk scored and mapped to the EU AI Act, GDPR, and HIPAA, with a remediation plan and a starter policy.
This guide is general information, not legal advice. Confirm specifics with your counsel or compliance team.