A Futurism article shared how ChatGPT told a person recovering from addiction that they needed meth. An X user showed how ChatGPT encouraged quitting medications cold turkey and, clinically speaking, delusions.
https://www.huffpost.com/entry/chat-gpt-therapy-dangers-goog_l_6894c08be4b015bc25049446