[sf-lug] Old Calculator Problems

Sujit K M kmsujit at gmail.com
Wed Aug 10 22:16:00 PDT 2016


On Wed, Aug 10, 2016 at 10:32 PM, Asheesh Laroia <asheesh at sandstorm.io> wrote:
> Hi Sujit,
>
> Very likely you are running into the inaccuracy of so-called "floating
> point" arithmetic. The topic is fascinating and mind-boggling, in my
> opinion.

Found something interesting also Decimal Accuracy or Precision or
Arthmetic Precision

https://www2.southeastern.edu/Academics/Faculty/dgurney/Math241/StatTopics/SciNot.htm
https://reference.wolfram.com/language/tutorial/NumericalPrecision.html
https://reference.wolfram.com/language/howto/ControlThePrecisionAndAccuracyOfNumericalResults.html

Python 2 : https://docs.python.org/2/tutorial/floatingpoint.html
Python 3 : https://docs.python.org/3/tutorial/floatingpoint.html




More information about the sf-lug mailing list