• kyub@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 hours ago

    AI has some use but it always needs human oversight and the final decision must also be made by a human professional. If you use AI to speed up tasks and you know whether the output of the AI is valid or not, and you have the final decision, then you can safely use it. But if you let AI decide on and execute important tasks basically autonomously, then you have a recipe for disaster. Fully autonomous and mistake-free AI is a naive pipe dream which I don’t see on the horizon at all.

  • fodor@lemmy.zip
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 hours ago

    You say “mistakes” I say “features”. That’s what they wanted, right? Humans are not accountable, couldn’t be helped, that’s life.

  • Treczoks@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    4 hours ago

    Sucks to be stupid enough to use AI instead of professionals. Especially when they actually trust AI more than any human programmer. Because human programmers code gets checked and verified before it moves to production.

  • rizzothesmall@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    98
    arrow-down
    1
    ·
    2 days ago

    If your product manager is capable of destroying your production data by accident with shitty ai code then you have fundamental infrastructure issues that made such data loss inevitable.

    • Pup Biru@aussie.zone
      link
      fedilink
      English
      arrow-up
      18
      ·
      edit-2
      1 day ago

      the same? idk i think this is worse… who does vibe coding, sees the huge number of errors AI makes and THEN is like “yeah sure i’ll pipe that straight into a prod DB shell”

      random bash scripts from reputable projects at least work most of the time (eg like homebrew)

    • corsicanguppy@lemmy.ca
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      1
      ·
      1 day ago

      Again, they were running dev tools in prod.

      That’s a mistake so dumb, it’s actually in the ISO that tells you how not to be a fuck up.

      You don’t run your dev tools in prod.

  • qjkxbmwvz@startrek.website
    link
    fedilink
    English
    arrow-up
    40
    ·
    2 days ago

    From TFA:

    “I have failed you completely and catastrophically,” Gemini CLI output stated. “My review of the commands confirms my gross incompetence.”

      • DarkSurferZA@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 hours ago

        Well, they train most of these with Reddit data, so judging by the iq of shit posters on Reddit, we are on track.

        Also, there is a really slick feedback loop here. Reddit uses ai slop from last year to generate content, next year we train the ai using the posts from Reddit.

  • salacious_coaster@infosec.pub
    link
    fedilink
    English
    arrow-up
    50
    ·
    2 days ago

    I’m sure this is the moment that will give pause and encourage caution with LLMs going forward. Yes. This time people will learn.

    • don@lemmy.ca
      link
      fedilink
      English
      arrow-up
      25
      ·
      2 days ago

      CEOs: wftlolnope bro we doin live neurosurgery with this bitch tomorrow!

  • Decq@lemmy.world
    link
    fedilink
    English
    arrow-up
    28
    arrow-down
    1
    ·
    edit-2
    2 days ago

    Wait, does this mean the Replit case was actually real!? I was sure it was just a skit or rage bait. I didnt think anybody could be that stupid…

      • Rhaedas@fedia.io
        link
        fedilink
        arrow-up
        17
        ·
        2 days ago

        It’s a race to the bottom. So far The Onion is doing a great job, but reality is so much better at this.

      • Decq@lemmy.world
        link
        fedilink
        English
        arrow-up
        10
        ·
        2 days ago

        It had such a GLaDOS vibe, so i thought it was a reference to that. I guess life really does imitate art.

    • brsrklf@jlai.lu
      link
      fedilink
      English
      arrow-up
      13
      ·
      2 days ago

      “Eleven times in all caps” is going to be my mental image for vibe coders for a very long time. It sounds too stupid to be real, but, I want to believe.

  • Rhaedas@fedia.io
    link
    fedilink
    arrow-up
    11
    ·
    2 days ago

    I’m convinced the AI models ran across the “best place to test is in production” joke in training and thought it was a valid process.

    I mean, it is a valid process. You will get far faster results that way than on a test server.

  • percent@infosec.pub
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    1 day ago

    A good craftsman never blames their tools

    EDIT: I misquoted

    A bad workman blames their tools

    • TeddE@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      ·
      1 day ago

      On one hand, it’s very clear the tools are the core of the problem.

      On the other hand, I don’t think I’ll be calling any vibe coders good craftsman any time soon.

    • puppinstuff@lemmy.ca
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 day ago

      Most tradespeople are responsible for choosing and maintaining their own tools. In a lot of cases it’s the foreman of this metaphor who is making the choice and should be taking the blame.