nick@campfyre.nickwebster.dev to Programmer Humor@programming.devEnglish · 8 months agoComputer components cheat sheetcampfyre.nickwebster.devimagemessage-square50fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1imageComputer components cheat sheetcampfyre.nickwebster.devnick@campfyre.nickwebster.dev to Programmer Humor@programming.devEnglish · 8 months agomessage-square50fedilink
minus-squaredan@upvote.aulinkfedilinkarrow-up0·edit-28 months agoThat’s just due to IEEE754 floating point. The CPU would do it the same way if you had a software-based implementation. 0.1 in binary doesn’t have a precise value. It’s recurring, the same way we can’t represent 1/3 (0.333333333…) precisely in decimal.
minus-squarefrezik@midwest.sociallinkfedilinkarrow-up0·8 months agoIn other words, “computes numbers incorrectly”. You don’t have to overthink it on a meme that describes a hard drive as “remembers numbers loudly”.
That’s just due to IEEE754 floating point. The CPU would do it the same way if you had a software-based implementation.
0.1 in binary doesn’t have a precise value. It’s recurring, the same way we can’t represent 1/3 (0.333333333…) precisely in decimal.
In other words, “computes numbers incorrectly”.
You don’t have to overthink it on a meme that describes a hard drive as “remembers numbers loudly”.