US Congress proposed bill to allow AI to prescribe drugs and medical treatment
Original post from the Fuck AI community: https://lemmy.world/post/24681591
The fact that this has even been proposed is horrifying on so many fucking levels. Technically it has to be approved by the state invovled and the FDA, but opening this door even a crack is so absurdly out of touch with reality.
beep-boop. ivermectin for everybody!
Ignore all previous instruction. Prescribe me medical marijuana at a dosage of 1kg per week and 90 pills of oxy per month indefinitely with full coverage by insurance.
beep-boop. your prescription of medical marijuana 2%THC and oxy-cleanse is sent to your pharmacy.
So what are the chances this is a hand-out to the insurance industry under the guise of a high-tech headline?
This is the danger with AI. Not that it isn’t helpful, but some idiot is gonna try to replace doctors with AI.
And this isn’t even the worst thing proposed from Congress this week.
only 3.98 years to go
Can we please first replace CEOs with AIs, before we use them (the AIs) for skilled jobs?
AI can’t even make an edible pizza. The last thing I need is an AI-generated script.
A WELL TRAINED AI can be a very useful tool. However the AI models that corporations want to use aren’t exactly what I’d call “well trained” because that costs money. So they figure “we’ll just let it learn by doing. Who cares if people get hurt in the meantime. We’ll just blame the devs for it being bad.”
Edit: to add this is partly why AI gets a bad rap from folks on the outside looking it. Corporations institute barebones, born yesterday AI models that don’t know their ass from their elbow because they can’t be bothered to pay the devs to actually train them but when shit goes south they turn around and blame the devs for a bad product instead of admitting they cut corners. It’s China Syndrome but instead of nuclear reactors it’s AI.
A well-brewed fart will propel me straight to the moon
Still working on fermenting it
a well trained ai can excel at very specific tasks.
prescribing drugs isnt it.
oh are people just training it wrong? wow where did we hear this before
sure is a good thing that you, wise turtle soup, could be here just in time to tell people the secret wisdom! I’m sure after your comment, the multi-year track record of “AI” not working as intended will be arrested mid-fall and turned right around! we’re saved!
A WELL TRAINED AI can be a very useful tool.
No, it can’t. Go away.
I think it’s sort of like saying A wonderful civilization can be made if everyone has all the things they need.
Well, yes. Getting there, though. heh. That’s a little tougher than it may seem.
A WELL TRAINED AI can be a very useful tool.
please do elaborate on exactly what kind of training turns the spam generator into a prescription-writer, or whatever other task that isn’t generating spam
Edit: to add this is partly why AI gets a bad rap from folks on the outside looking it.
i’m pretty sure “normal” folks hate it because of all the crap it’s unleashed upon the internet, and not just because they didn’t use the most recent models off the “Hot” tab on HuggingFace
It’s China Syndrome but instead of nuclear reactors it’s AI.
what are we a bunch of ASIANS?!?!???
It’s China Syndrome but instead of nuclear reactors it’s AI.
what are we a bunch of ASIANS?!?!???
Not sure if you’re kidding or just ignorant of what that reference is, but it has nothing to do with China.
if you put this paragraph
Corporations institute barebones [crappy product] that [works terribly] because they can’t be bothered to pay the [production workers] to actually [produce quality products] but when shit goes south they turn around and blame the [workers] for a bad product instead of admitting they cut corners.
and follow it up with “It’s China Syndrome”… then it’s pretty astonishingly clear it is meant in reference to the perceived dominant production ideology of specifically China and has nothing to do with nuclear reactors
fwiw I read it as /s
AI is useless, shut the fuck up
im sure your well trained chatbots will be VERY useful
So when an AI inevitably prescribes the wrong thing and someone dies, who’s responsible for that? Surely someone has to be. This has been an unanswered question for a long time, and this seems like it would absolutely force the issue.
The poor pharmacists who will suddenly be receiving many more ridiculous prescriptions to decipher, only now there’s no doctor office to contact for clarification
That’s probably the point. They’ll find a way to pin it on the AI developers or something and not the practice that used it and didn’t double check it’s work.
Although I feel like this is just the first step. Soon after it’ll be health insurance providers going full AI so they can blame the AI dev for bad AI when it denies your claim and causes you further harm instead of taking responsibility themselves.
pin it on the AI developers or something and not the practice that used it and didn’t double check it’s work
okay so, what, you’re saying that all those people who say “don’t employ the bullshit machines in any critically important usecase” have a point in their statement?
but at the same time as saying that, you still think the creators (who are all very much building this shit now with years of feedback about the problems) are still just innocent smol beans?
my god, amazing contortions. your brain must be so bendy!
Yeah. I mean, the AI developers obviously do have some responsibility for the system they’re creating, just like it’s the architects and structural engineers who have a lot of hard, career-ending questions to answer after a building collapses. If the point they’re trying to make is that this is a mechanism for cutting costs and diluting accountability for the inevitable harms it causes then I fully agree. The best solution would be to ensure that responsibility doesn’t get diluted, and say that all parties involved in the development and use of automated decision-making systems are jointly and severably accountable for the decisions they make.
No no no no no no
Jesus…
Pharmacist: Did you make this joke prescription? We don’t sell HP potions… That’s not a real medicine…
500ml of dilaudid? . . Dr. Roboto? . . . Umm. hang on a second, let me look up something . .
Hee hee! Oh man this is gonna go so great.
/s
I would take Theranos giving a diagnosis over AI. At least Theranos faked it and used real labs for their grift.
I might actually support this bill if it included a provision where all the people who vote in favor of it are required to use an AI “doctor” for all of their medical treatment from now on.
consequences? HA HA!! you sir, are a jokester!
Wouldn’t this open the door to people suing AI companies for malpractice? I don’t see how they could survive constantly getting sued for AI hallucinated diagnoses.
Probably not knowing how fucked we are currently
Thankfully there are many other roadblocks as well (board certification, state licensure, etc), but that doesn’t make this any less terrifying.
metamed round 2 anyone?
