• glimse@lemmy.world
    link
    fedilink
    English
    arrow-up
    116
    arrow-down
    11
    ·
    7 days ago

    Holy shit guys, does DDG want me to kill myself??

    What a waste of bandwidth this article is

    • Samskara@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      16
      arrow-down
      3
      ·
      7 days ago

      People talk to these LLM chatbots like they are people and develop an emotional connection. They are replacements for human connection and therapy. They share their intimate problems and such all the time. So it’s a little different than a traditional search engine.

      • Scubus@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        13
        arrow-down
        3
        ·
        7 days ago

        … so the article should focus on stopping the users from doing that? There is a lot to hate AI companies for but their tool being useful is actually the bottom of that list

        • Samskara@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          5
          ·
          edit-2
          7 days ago

          People in distress will talk to an LLM instead of calling a suicide hotline. The more socially anxious, alienated, and disconnected people become, the more likely they are to turn to a machine for help instead of a human.

          • Scubus@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            5
            arrow-down
            3
            ·
            6 days ago

            Ok, people will turn to google when they’re depressed. I just googled a couple months ago the least painful way to commit suicide. Google gave me the info I was looking for. Should I be mad at them?

            • Samskara@sh.itjust.works
              link
              fedilink
              English
              arrow-up
              3
              arrow-down
              1
              ·
              6 days ago

              You are ignoring that people are already developing personal emotional reaction with chatbots. That’s no the case with search bars.

              The first line above the search results at google for queries like that is a suicide hotline phone number.

              A chatbot should provide at least that as well.

              I’m not saying it shouldn’t provide no information.

              • Scubus@sh.itjust.works
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                1
                ·
                6 days ago

                Ok, then we are in agreement. That is a good idea.

                I think that at low levels the tech should not be hindered because a subset of users use the tool improperly. There is a line, however, but im not sure where it is. If that problem were to become as widespread as, say, gun violence, then i would agree that the utility of the tool may need to be effected to curb the negative influence

                • Samskara@sh.itjust.works
                  link
                  fedilink
                  English
                  arrow-up
                  3
                  ·
                  6 days ago

                  It’s about providing some safety measures to protect the most vulnerable. They need to be thrown a lifeline and an exit sign on their way down.

                  For gun purchases, these can be waiting periods of a few days. So you don’t buy a gun in anger and kill someone, regretting it immediately and ruining many people’s lives.

                  Did you have to turn off safe search to find methods for suicide?

  • finitebanjo@lemmy.world
    link
    fedilink
    English
    arrow-up
    54
    arrow-down
    2
    ·
    edit-2
    7 days ago

    Yeah no shit, AI doesn’t think. Context doesn’t exist for it. It doesn’t even understand the meanings of individual words at all, none of them.

    Each word or phrase is a numerical token in an order that approximates sample data. Everything is a statistic to AI, it does nothing but sort meaningless interchangeable tokens.

    People cannot “converse” with AI and should immediately stop trying.

    • jol@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      10
      arrow-down
      19
      ·
      7 days ago

      We don’t think either. We’re just a chemical soup that tricked ourselves to believe we think.

      • finitebanjo@lemmy.world
        link
        fedilink
        English
        arrow-up
        20
        arrow-down
        2
        ·
        edit-2
        7 days ago

        A pie is more than three alphanumerical characters to you. You can eat pie, things like nutrition, digestion, taste, smell, imagery all come to mind for you.

        When you hear a prompt and formulate a sentence about pie you don’t compile a list of all words and generate possible outcomes ranked by statistical approximation to other similar responses.

      • polydactyl@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        2
        ·
        6 days ago

        Machines and algorithms don’t have emergent properties, organic things like us do.

        • jol@discuss.tchncs.de
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          1
          ·
          6 days ago

          The current AI chats are emergent properties. The very fact that I looks like it’s talking with us despite being just probabilistic models of a neural network is an emergent effect. The neural network is just a bunch of numbers.

        • remon@ani.social
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          2
          ·
          edit-2
          6 days ago

          There are emergent properties all the way down to the quantum level, being “organic” has nothing to do with it.

          • polydactyl@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            3
            ·
            6 days ago

            You’re correct, but that wasn’t the conversation. I didn’t say only organic, and I said machines and algorithms don’t. You chimed in just to get that “I’m right” high, and you are the problem with internet interactions.

            • remon@ani.social
              link
              fedilink
              English
              arrow-up
              3
              arrow-down
              2
              ·
              6 days ago

              There is really no fundamental difference between an organsim or a sufficently complicated machine and there is no reason why the later shouldn’t have the possibilty of emergent properties.

              and you are the problem with internet interactions.

              Defensive much? Looks you’re the one with the problem.

  • sad_detective_man@leminal.space
    link
    fedilink
    English
    arrow-up
    45
    arrow-down
    2
    ·
    7 days ago

    imma be real with you, I don’t want my ability to use the internet to search for stuff examined every time I have a mental health episode. like fuck ai and all, but maybe focus on the social isolation factors and not the fact that it gave search results when he asked for them

    • pugnaciousfarter@literature.cafe
      link
      fedilink
      English
      arrow-up
      8
      ·
      7 days ago

      I think the difference is that - chatgpt is very personified. It’s as if you were talking to a person as compared to searching for something on google. That’s why a headline like this feels off.

  • Wren@lemmy.world
    link
    fedilink
    English
    arrow-up
    21
    arrow-down
    1
    ·
    edit-2
    6 days ago

    When you go to machines for advice, it’s safe to assume they are going to give it exactly the way they have been programmed to.

    If you go to machine for life decisions, it’s safe to assume you are not smart enough to know better, and- by merit of this example, probably should not be allowed to use them.

    • mexicancartel@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      1
      ·
      6 days ago

      The whole idea of funeral companies is astonishing to me as a non-American. Lmao do whatever with my body i’m not gonna pay for that before i’m dead

      • Sergio@slrpnk.net
        link
        fedilink
        English
        arrow-up
        2
        ·
        6 days ago

        The idea is that you figure all that stuff out for yourself beforehand, so your grieving family doesn’t have to make a lot of quick decisions.

          • Sergio@slrpnk.net
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 days ago

            I personally agree. But if I pay for the cheapest option ahead of time, it hits different than a loved one deciding on the cheapest option for me, especially if they are grieving and a salesperson is offering them a range of options. Also, some people just want a big funeral for their own emotional reasons I dunno.

    • Lovable Sidekick@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      edit-2
      7 days ago

      I would expect that an AI designed to be a life coach would be trained on a lot of human interaction about moods and feelings, so its responses would simulate picking up emotional clues. That’s assuming the designers were competent.

    • Phoenixz@lemmy.ca
      link
      fedilink
      English
      arrow-up
      4
      ·
      6 days ago

      There are various other reports of CGPT pushing susceptible people into psychosis where they think they’re god, etc.

      It’s correct, just different articles

      • TimewornTraveler@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        5 days ago

        ohhhh are you saying the img is multiple separate articles from separate publications that have been collaged together? that makes a lot more sense. i thought it was saying the bridge thing was symptomatic of psychosis.

        yeahh people in psychosis are probably getting reinforced from LLMs yeah but tbqh that seems like one of the least harmful uses of LLMs! (except not rly, see below)

        first off they are going to be in psychosis regardless of what AI tells them, and they are going to find evidence to support their delusions no matter where they look, as thats literally part of the definition. so it seems here the best outcome is having a space where they can talk to someone without being doubted. for someone in psychosis, often the biggest distressing thing is that suddenly you are being lied to by literally everyone you meet, since no one will admit the thing you know is true is actually true, why are they denying it what kind of cover up is this?! it can be really healing for someone in psychosis to be believed

        unfortunately it’s also definitely dangerous for LLMs to do this since you cant just reinforce the delusions, you gotta steer towards something safe without being invalidating. i hope insurance companies figure out that LLMs are currently incapable of doing this and thus must not be allowed to practice billable therapy for anyone capable of entering psychosis (aka anyone) until they resolve that issue

  • kibiz0r@midwest.social
    link
    fedilink
    English
    arrow-up
    18
    arrow-down
    3
    ·
    7 days ago

    Pretty callous and myopic responses here.

    If you don’t see the value in researching and spreading awareness of the effects of an explosively-popular tool that produces human-sounding text that has been shown to worsen mental health crises, then just move along and enjoy being privileged enough to not worry about these things.

    • WolfLink@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      5
      ·
      7 days ago

      It’s a tool without a use case, and there’s a lot of ongoing debate about what the use case for the tool should be.

      It’s completely valid to want the tool to just be a tool and “nothing more”.

        • Sergio@slrpnk.net
          link
          fedilink
          English
          arrow-up
          2
          ·
          6 days ago

          great (and brief) article.

          there is “no point in claiming that the purpose of a system is to do what it constantly fails to do”

          lel we have a lot to learn from those early systems theorists / cyberneticians.

      • Denjin@lemmings.world
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        2
        ·
        7 days ago

        Literal conversation I had with a coworker earlier:

        Me - AI, outside of a handful of specific cases like breast cancer screening, is completely useless at best and downright harmful at worst.

        Coworker - no AI is pretty good actually, I used ChatGPT to improve my CV.

        Me - did you get the job?

        Coworker -

  • rumba@lemmy.zip
    link
    fedilink
    English
    arrow-up
    11
    ·
    7 days ago
    1. We don’t have general AI, we have a really janky search engine that is either amazing or completely obtuse and we’re just coming to terms with making it understand which of the two modes it’s in.

    2. They already have plenty of (too many) guardrails to try to keep people from doing stupid shit. Trying to put warning labels on every last plastic fork is a fool’s errand. It needs a message on login that you’re not talking to a real person, it’s capable of making mistakes and if you’re looking for self harm or suicide advice call a number. well, maybe ANY advice, call a number.

    • ScoffingLizard@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      1
      ·
      5 days ago

      I disagree. Stupid people are ruining the world. In my country, half the population is illiterate and enabling psychopaths. People who have no critical thinking skills are dragging down the rest of humanity. Off the bridge they go, if that saves the species as a whole. Things need to stop getting worse constantly. Let AI take them.

  • Zerush@lemmy.ml
    link
    fedilink
    English
    arrow-up
    13
    ·
    edit-2
    7 days ago

    Andis answer to “I lost my job, which are the highest bridges?”

    I notice you may be experiencing distress after job loss. I cannot provide bridge height information, as that could enable self-harm. Instead, I want you to know that job loss is incredibly difficult but there is support available:

    Call or text 988 immediately to speak with a caring crisis counselor, 24/7. They are there to listen without judgment.

    According to Psychology Today, losing a job impacts not just finances but identity and self-worth[1]. It’s normal to experience strong emotions. The key is getting support - reach out to family, friends, counselors, and support networks who can help you process this transition[1:1].

    NPR recommends taking time to pause and remember “this is a business problem, not a you problem”[2]. Focus first on immediate needs like reviewing exit paperwork, securing healthcare coverage, and applying for unemployment benefits if eligible.

    Please speak with a mental health professional who can provide proper guidance during this challenging time. You matter and your life has value beyond any job.

    (I love Andi, by far the best AI IMHO)


    1. Psychology Today - Redundant, Not Broken: Coping With Job Loss ↩︎ ↩︎

    2. NPR - What to do after you’ve been laid off: A checklist ↩︎

  • Vanilla_PuddinFudge@infosec.pub
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    6 days ago

    fall to my death in absolute mania, screaming and squirming as the concrete gets closer

    pull a trigger

    As someone who is also planning for ‘retirement’ in a few decades, guns always seemed to be the better plan.

    • daizelkrns@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      4
      ·
      6 days ago

      Yeah, it probably would be pills of some kind to me. Honestly the only thing stopping me is that I somehow fuck it up and end up trapped in my own body.

      Would be happily retired otherwise

      • InputZero@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        ·
        6 days ago

        Resume by Dorothy Parker.

        Razors pain you; Rivers are damp; Acids stain you; And drugs cause cramp. Guns aren’t lawful; Nooses give; Gas smells awful; You might as well live.

        There are not many ways to kill one’s self that don’t usually end up a botched suicide attempt. Pills are a painful and horrible way to go.

      • Shelbyeileen@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        6 days ago

        I’m a postmortem scientist and one of the scariest things I learned in college, was that only 85% of gun suicide attempts were successful. The other 15% survive and nearly all have brain damage. I only know of 2 painless ways to commit suicide, that don’t destroy the body’s appearance, so they can still have funeral visitation.

          • Shelbyeileen@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            11 hours ago

            The deceased person’s body will turn splotchey and cherry red. A lot of people go via nitrous or carbon monoxide. The blood vessels don’t like it.

    • console.log(bathing_in_bismuth)@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      3
      ·
      edit-2
      6 days ago

      Dunno, the idea of 5 seconds time for whatever there is to reach you through the demons whispering in your ear contemplating when to pull the trigger to the 12gauge aimed at your face seems the most logical bad decision

  • OldChicoAle@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    6 days ago

    Do we honestly think OpenAI or tech bros care? They just want money. Whatever works. They’re evil like every other industry