Winters’ lawyers alleged the platform “repeatedly and insistently misdiagnosed” him while drawing on previous discussions about religion to assure him he would recover.

I forgot that it “learns” now, I haven’t tried it in a long while 🤦

It doesn’t “learn” people are too stupid to start a new thread. That brings it back to default.

It didn’t used to. There was the whole “memories” thing that it kept between conversations. I hated it

Duno why you’re being downvoted, memories are a thing that all cloud AI providers have

I remove my own default upvote from my comments because I’m a weirdo

fair play 😄

By learning it just creates a list of “facts” it extracts from the conversation.

There’s no updating model weights.

(Though I suspect you know that due to your use of quotes this is not for posterity)

The lawsuit, which was filed at the San Francisco County Superior Court on 21 July, details how Winter was a regular ChatGPT user and came to rely it on it for medical advice, resisting efforts from family members and friends to make him go to hospital.

This dipshit is why we have so many safety labels on things

I clicked on the article to make sure: he used regular ChatGPT, not some specifically medical AI chatbot.

It’s like with Fox “News": it’s not news, it’s entertainment. Taking it seriously is kinda dumb*. But at the same time, that’s no reason to just let it fester and destroy people.

It’s actually worse than Fox News. The companies are pushing all this not only like it actually works, but like it’s the second coming of Christ. Which is criminally insane.

* or desperate

medical chatbot would be malpractice lawsuit pinata

I guess so; otoh I’m pretty sure some sort of AI-assisted healthcare exists.

I’m surprised they don’t have giant disclaimers to not believe medical advice from these bots. That seems much cheaper than paying lawsuits.

They do, but you can’t say “this isn’t medical advice” and then turn around and give medical advice. Especially to the point of discouraging seeing a doctor.

AI psychosis is going to be great for culling the herd of morons.

When I was being encouraged to use Copilot at work, MS made it clear that their product was intended for “entertainment purposes only.” I was sooooooooooo entertained.

Imagine how entertaining it would be to get medical advice from an LLM instead of advice on how to do the job I did just fine for 10 years before LLMs were invented. Very, very entertaining.

“American man” is all the explanation you need here. If you have to pay for doctors, of course people who can’t pay are going to turn to a free alternative that seems to offer some hope. That’s one of the reasons why you don’t have to pay to see a doctor in civilized countries.

“American man” is all the explanation you need here.

It’s really not. AI Psychosis is not exclusive to the US, nor is LLM use. These products are every bit as harmful to everyone else outside the US.

I believe the commenter meant that the price of medical care in the USA push people to extensively rely on AI (or online communities btw), not that Americans are especially gullible or prone to AI psychosis.

That’s fair. Good point.

Man brings himself to the brink of death.

Man brings man to the brink of death, for profit

I’m of two minds about this.

Part of me wanted to blithely reply that “nothing of value was lost”; However, it’s undeniable that this is a societal problem and this person is a victim every bit as much as someone who gets injured in a Tesla because it decides to run a red light and slam into a tree after a bad software update.

These products are built to be manipulative and harmful in the long-term, and by rights, should be regulated into oblivion. The LLM companies are just in the process of calibrating and tweaking the product so it kills more like cigarettes and less like interacting with a Terminator, and for that to happen, a few people have to die. They’ve almost certainly calculated out the potential litigation costs and accepted the risk.

And most of us can’t avoid these products entirely because our job requires us to develop a basic proficiency in their use.