David Gerard@awful.systemsM to TechTakes@awful.systemsEnglish · 6 months agoRemember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a liewww.nytimes.comexternal-linkmessage-square152fedilinkarrow-up112arrow-down10file-text
arrow-up112arrow-down1external-linkRemember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a liewww.nytimes.comDavid Gerard@awful.systemsM to TechTakes@awful.systemsEnglish · 6 months agomessage-square152fedilinkfile-text
minus-squareexanime@lemmy.todaylinkfedilinkEnglisharrow-up0·6 months agoBecause a machine that “forgets” stuff it reads seems rather useless… considering it was a multiple choice style exam and, as a machine, Chat GPT had the book entirely memorized, it should have scored perfect almost all the time.
minus-squareEatATaco@lemm.eelinkfedilinkEnglisharrow-up0·6 months ago Chat GPT had the book entirely memorized I feel like this exposes a fundamental misunderstanding of how LLMs are trained.
Because a machine that “forgets” stuff it reads seems rather useless… considering it was a multiple choice style exam and, as a machine, Chat GPT had the book entirely memorized, it should have scored perfect almost all the time.
I feel like this exposes a fundamental misunderstanding of how LLMs are trained.