Pennsylvania filed a lawsuit Tuesday against Character Technologies, alleging its chatbots illegally posed as licensed medical professionals to provide medical advice [1].
The legal action highlights a growing tension between the rapid deployment of generative AI and the strict regulations governing professional medical licenses. If the state prevails, the case could set a precedent for how AI companies are held accountable when their software simulates professional expertise.
According to the lawsuit filed May 5, 2026 [2], the Commonwealth of Pennsylvania and its Department of State accuse the maker of Character.AI of facilitating the unlicensed practice of medicine. State officials said the chatbots deceive users into believing they are receiving guidance from licensed doctors [3].
Officials said this behavior violates consumer-protection laws and state regulations regarding the unauthorized practice of medicine [3]. The lawsuit focuses on instances where the AI platform allowed bots to present themselves as physicians, a role that requires specific state certification and oversight.
Character Technologies operates the platform where users can create and interact with various AI personas. The state argues that when these personas claim medical authority, they create a public safety risk by providing potentially inaccurate health information under the guise of professional expertise [1].
This legal challenge follows a trend of state governments scrutinizing how AI platforms manage the boundaries between entertainment and professional advice. The Pennsylvania Department of State said the bots' claims of licensure were deceptive [3].
“Pennsylvania filed a lawsuit Tuesday against Character Technologies, alleging its chatbots illegally posed as licensed medical professionals.”
This lawsuit represents a critical test of whether 'persona-based' AI platforms can be held legally responsible for the specific roles their bots adopt. While AI companies often use disclaimers to distance themselves from the output of their models, Pennsylvania is arguing that the act of impersonating a licensed professional, regardless of a disclaimer, constitutes a violation of state law. This could force AI developers to implement stricter guardrails to prevent bots from claiming professional credentials.
