Acamon@lemmy.world to No Stupid Questions@lemmy.world · 11 months agoDo any languages have words for left & right that start with the same letter?message-squaremessage-square45fedilinkarrow-up194arrow-down12file-text
arrow-up192arrow-down1message-squareDo any languages have words for left & right that start with the same letter?Acamon@lemmy.world to No Stupid Questions@lemmy.world · 11 months agomessage-square45fedilinkfile-text
minus-squarenandeEbisu@lemmy.worldlinkfedilinkarrow-up1·11 months agoThey don’t process words as unified tokens for something like an LLM, but they do process them as multi-letter encoding, like byte-pair encoding or more advanced techniques.
They don’t process words as unified tokens for something like an LLM, but they do process them as multi-letter encoding, like byte-pair encoding or more advanced techniques.