Catoblepas

@Catoblepas@lemmy.blahaj.zone · Joined ⁨Jun⁩ ⁨2023⁩

Replying to @⁨joe@lemmy.world⁩

Oh, so that is a concern when it comes to pointing out the ways in which AI is a solution looking for a problem, but not when it comes to pointing out this could kill people?

Not that you bothered to ask, but my solution is to add enough operators so that they aren’t working barely staffed at all times and getting overwhelmed the second more than a few calls come in. Working constantly at minimum staffing is the problem, this was solvable before 2022 without AI and it still isn’t necessary.

Replying to @⁨joe@lemmy.world⁩

The difference being that operators aren’t working tired, distracted, and irritable for their entire shift while AI is functionally brain damaged the entire time.

If you’re going to refuse to acknowledge that just listening for the word ‘yes’ isn’t enough in an emergency situation then there’s no point in continuing this. Which, if it’s literally just a binary yes/no why the hell do we need AI and not ‘press 1 if you’re calling about x emergency’?

Replying to @⁨joe@lemmy.world⁩

Again, a human being and an LLM strapped on top of voice recognition are not the same thing. A person can understand tone and context that an LLM can’t. It absolutely can’t perform at the same level while taking fucking drive through orders and you think it can function in an emergency? ‘Well people can make mistakes too’ isn’t going to bring back anyone who dies because of this.

Replying to @⁨joe@lemmy.world⁩

It doesn’t have to be a stroke, do you really think that’s the only thing that can make people confused or give anything other than the expected answer? Panic, being hard of hearing, sometimes people even have to pretend to be calling someone else so that they can call for help in front of an abuser.

You’re really married to the idea of this being unable to go wrong.

Replying to @⁨percent@infosec.pub⁩

What if someone is obviously out of their mind and says yes? Random example, say someone has a stroke and has just barely figured out how to use the big red emergency call button on their phone screen. The AI asks if they are calling about blah blah emergency. Maybe the person only understands half of it, thinks they’re being asked if they’re calling about an emergency and say “yes”. Now they’re stuck having a form letter read to them by AI while their brain is dying. A person would catch something was up even if they said yes.

The article even notes this can be a problem without anything medical going on:

It’s also possible that AI agents handling 911 triage could fail to understand individuals with stronger accents and dialects, as well as differences in pitch and articulation. This is because AI is programmed with automatic speech recognition systems and, therefore, could potentialy be unreliable when presented with a speech unlike the ones used the AI is trained to recognize.

Responding to people having emergencies is too important a task to leave up to voice recognition slapped on top of an LLM.

Replying to @⁨ItsNotImportant24@lemmy.ml⁩

Yup, just read an article about that the other day. They even acknowledged it was going to keep happening to the person whose vehicle was mistakenly flagged because of a partial ID match, and just advised him to keep the car at home until they figured out how to fix it. In his case it wasn’t as big a deal since it was a rental, but can you imagine being told to not drive your own fucking car or the cops will be automatically called to come pull you over as a carjacker??