• 1 Post
  • 18 Comments
Joined 2 years ago
cake
Cake day: July 28th, 2023

help-circle













  • While you are correct that there likely is no intention and certainly no self-awareness behind the scheming, the researchers even explicitly list the option that the AI is roleplaying as an evil AI, simply based on its training data, when discussing the limitations of their research, it still seems a bit concerning. The research shows that given a misalignment between the initial prompt and subsequent data modern LLMs can and will ‘scheme’ to ensure their given long-term goal. It is no sapient thing, but a dumb machine with the capability to decive its users, and externalise this as shown in its chain of thought, when there are goal misalignments seems dangerous enough. Not at the current state of the art but potentially in a decade or two.






  • Nice story. Were those just plain zombies, or some other kind of intelligent undead? Because necromancers can raise both types in a fight and this cloud sounds like a raising/converting effect some of those intelligent undead can do. I have absolutely no idea why they were friendly, because they usually are either loyal to the necromancer or just plain agressive against the living.

    Also nice that you stayed stubborn on these useless bugbats.