Hi everyone,
I have encountered a strange thing after changed the number of decimals to 12 in the preferences dialog, .
When i set the value of Density to 7850 kg/m^3 in the material settings dialog, i got 7850.000000000001 kg/m^3.
Does anyone have any idea?
Thanks for help!
OS: Windows 10
Word size of OS: 64-bit
Word size of FreeCAD: 32-bit
Version: 0.18.16093 (Git)
Build type: Release
Branch: releases/FreeCAD-0-18
Hash: 690774c0effe4fd7b8d2b5e2fb2b8c8d145e21ce
Python version: 2.7.14
Qt version: 4.8.7
Coin version: 4.0.0a
OCC version: 7.2.0
Decimal's problem
Forum rules
Be nice to others! Read the FreeCAD code of conduct!
Be nice to others! Read the FreeCAD code of conduct!
Re: Decimal's problem
Seems that with 12 decimals you are touching the precision of the internal calculation / representation.
A Sketcher Lecture with in-depth information is available in English, auf Deutsch, en français, en español.
Re: Decimal's problem
Thanks, kisolre.
So, is there any way to avoid this?
Re: Decimal's problem
Avoid what? Displaying numbers with such precision? Why do you even need that? According to https://hypertextbook.com/facts/1996/Mi ... llip.shtml that is the size of an atom nucleus
Just set the number of decimals to 5-6 and you are good to go for almost any real life situation
Re: Decimal's problem
Just notice that changing the decimal number that is displayed doesn't change the internal precision used for computations.