orhtej2@eviltoast.org to Programmer Humor@programming.devEnglish · 20 hours agoFloating point arithmeticseviltoast.orgimagemessage-square42linkfedilinkarrow-up1681arrow-down14
arrow-up1677arrow-down1imageFloating point arithmeticseviltoast.orgorhtej2@eviltoast.org to Programmer Humor@programming.devEnglish · 20 hours agomessage-square42linkfedilink
minus-squareWhiskyTangoFoxtrot@lemmy.worldlinkfedilinkarrow-up20arrow-down1·20 hours agoShow how 1/3 can be precisely represented in floating point.
minus-squareBigMikeInAustin@lemmy.worldlinkfedilinkEnglisharrow-up35·19 hours agofl_numerator = 1 fl_denominator = 3 And division is a “stretch goal” once we get funding.
minus-squareGork@sopuli.xyzlinkfedilinkarrow-up3·18 hours agoHow many decimal places can it be stretched?
minus-squareMyBrainHurts@piefed.calinkfedilinkEnglisharrow-up2·17 hours agoAs usual, the best jokes are in the comments. (Though goddamn I chuckled at the meme.)
minus-squaremarcos@lemmy.worldlinkfedilinkarrow-up1·17 hours agoDo you have a computer type that can represent the entire rational set?
minus-squarecalcopiritus@lemmy.worldlinkfedilinkarrow-up4·13 hours agoYes. Have a structure with 2 BigInts. Treat one as the numerator. The other as denominators. It might not be efficient or fast. But it is possible.
minus-squaremarcos@lemmy.worldlinkfedilinkarrow-up1·14 minutes agoYou are proposing that can represent the entire rational set?
minus-squareWhiskyTangoFoxtrot@lemmy.worldlinkfedilinkarrow-up3·16 hours agoNo. They all need to mimic certain numbers.
minus-squaremarcos@lemmy.worldlinkfedilinkarrow-up1·13 minutes agoSo, you have a notation that can represent the entire rational set? What exactly is being mimicked?
Show how 1/3 can be precisely represented in floating point.
fl_numerator = 1
fl_denominator = 3
And division is a “stretch goal” once we get funding.
How many decimal places can it be stretched?
As usual, the best jokes are in the comments. (Though goddamn I chuckled at the meme.)
Do you have a computer type that can represent the entire rational set?
Yes. Have a structure with 2 BigInts. Treat one as the numerator. The other as denominators.
It might not be efficient or fast. But it is possible.
You are proposing that can represent the entire rational set?
No. They all need to mimic certain numbers.
So, you have a notation that can represent the entire rational set?
What exactly is being mimicked?