ekZepp@lemmy.world to Technology@lemmy.mlEnglish · 1 month agoStudy Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrongfuturism.comexternal-linkmessage-square116fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkStudy Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrongfuturism.comekZepp@lemmy.world to Technology@lemmy.mlEnglish · 1 month agomessage-square116fedilink
minus-squareeerongal@ttrpg.networklinkfedilinkarrow-up0·1 month agoWorth noting this study was done on gpt 3.5, 4 is leagues better than 3.5. I’d be interested to see how this number has changed
minus-squarezero_spelled_with_an_ecks@programming.devlinkfedilinkarrow-up0·1 month ago4 made up functions that didn’t exist last time I asked in a programming question.
minus-squareHotzilla@sopuli.xyzlinkfedilinkarrow-up0·1 month agoThere is huge gap between 3.5 and 4 especially in coding related questions. GPT3.5 does not have large enough token size to handle harder code related questions.
Worth noting this study was done on gpt 3.5, 4 is leagues better than 3.5. I’d be interested to see how this number has changed
4 made up functions that didn’t exist last time I asked in a programming question.
There is huge gap between 3.5 and 4 especially in coding related questions. GPT3.5 does not have large enough token size to handle harder code related questions.