Researchers found Meta’s popular Llama 3.1 70B has a capacity to recite passages from ‘The Sorcerer’s Stone’ at a rate much higher than could happen by chance.
Researchers found Meta’s popular Llama 3.1 70B has a capacity to recite passages from ‘The Sorcerer’s Stone’ at a rate much higher than could happen by chance.
If you ask ‘what’s the fifth word on the hundredth page of the first edition?,’ the AI will almost certainly guess.
If it guesses wrong, people go ‘Ah-HA! It’s useless, for not knowing that!’
If it guesses right, people go ‘Ah-HA! Knowing that fact is theft!’