ZILtoid1991@lemmy.world to 196@lemmy.blahaj.zoneEnglish · 8 days agoRule2346757123926472142107lemmy.worldimagemessage-square12linkfedilinkarrow-up1232arrow-down11
arrow-up1231arrow-down1imageRule2346757123926472142107lemmy.worldZILtoid1991@lemmy.world to 196@lemmy.blahaj.zoneEnglish · 8 days agomessage-square12linkfedilink
minus-squareWirlocke@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up1·5 days agoLLMs don’t see numbers as numbers, they see them as tokens which is like a word or piece of a word. So “123456789” is like a single word to the LLM because it’s a common enough string of characters. This is also why they struggle with math.
LLMs don’t see numbers as numbers, they see them as tokens which is like a word or piece of a word.
So “123456789” is like a single word to the LLM because it’s a common enough string of characters. This is also why they struggle with math.