#floatingpointarithmetic — Public Fediverse posts

Floating point madness.

How floating point can drive you crazy. Covers lots of topics like NaN , Infinity and when working with numbers with vastly different magnitudes.

Well worth a watch :)

https://www.youtube.com/watch?v=tw99HxpONws

#programming #math #floatingPointArithmetic

This error message in our app is why you don't put == or != between two floating point numbers in your code! 😅

> Error: Internal miscalculation: Volume (89.99999999999999) is not equal to upper limit (90.0)

#Code #Math #Python #FloatingPointArithmetic

What Every Computer Scientist Should Know about Floating-Point Arithmetic [pdf]

https://www.itu.dk/~sestoft/bachelor/IEEE754_article.pdf

#HackerNews #FloatingPointArithmetic #ComputerScience #IEEE754 #ProgrammingKnowledge #TechEducation

What Every Computer Scientist Should Know about Floating-Point Arithmetic [pdf]

https://www.itu.dk/~sestoft/bachelor/IEEE754_article.pdf

#HackerNews #FloatingPointArithmetic #ComputerScience #IEEE754 #ProgrammingKnowledge #TechEducation

What Every Computer Scientist Should Know about Floating-Point Arithmetic [pdf]

https://www.itu.dk/~sestoft/bachelor/IEEE754_article.pdf

#HackerNews #FloatingPointArithmetic #ComputerScience #IEEE754 #ProgrammingKnowledge #TechEducation

What Every Computer Scientist Should Know about Floating-Point Arithmetic [pdf]

https://www.itu.dk/~sestoft/bachelor/IEEE754_article.pdf

#HackerNews #FloatingPointArithmetic #ComputerScience #IEEE754 #ProgrammingKnowledge #TechEducation

What Every Computer Scientist Should Know about Floating-Point Arithmetic [pdf]

https://www.itu.dk/~sestoft/bachelor/IEEE754_article.pdf

#HackerNews #FloatingPointArithmetic #ComputerScience #IEEE754 #ProgrammingKnowledge #TechEducation

Thanks Duolingo! I appreciate myself some EXTRA precise stats! 😎

#Duolingo #Floats #FloatingPoint #FloatingPointArithmetic #Precision

#fp #floatingpoint #FloatingPointArithmetic

Interesting floating-point summation tip [ https://twitter.com/raymondh/status/1301800636866940928 ]:

"Raymond Hettinger @raymondh

#Python floating point ninja tip: Use parentheses to regroup sums to minimize accumulated round-off error.

Instead of:
a + b + c + d + e + f + g + h

Write:
((a + b) + (c + d)) + ((e + f) + (g + h))

Note, the total work is unchanged."

For more on this see [ https://en.wikipedia.org/wiki/Pairwise_summation ]

#FloatingPointArithmetic #Python #Programming