Excel 2000 : calculation error

S

Sleeper

Morning,

I get calculation errors with calculations as simple as a + or a -.
Here is an example :
type in a cell =1.245-1.155
the result should be 0.09, but is 0.0900000000000001.
Then a round formula is compulsory to use some others such as
IF(cell=0.09,....).

Is it possible to fix this error?
 
N

Nick Hodge

You'll find that no computer can accurately represent floating point
numbers. This way you will get rounding errors at the extremities of
precision.

To overcome this totally you either have to use ROUND, as you have already
found or Tools>Options...>Calculation>precision as displayed. This will
cause excel to use only the formatted precision

--
HTH
Nick Hodge
Microsoft MVP - Excel
Southampton, England
(e-mail address removed)
 
S

Sleeper

Thank you Nick for your explanation.

Nick Hodge said:
You'll find that no computer can accurately represent floating point
numbers. This way you will get rounding errors at the extremities of
precision.

To overcome this totally you either have to use ROUND, as you have already
found or Tools>Options...>Calculation>precision as displayed. This will
cause excel to use only the formatted precision

--
HTH
Nick Hodge
Microsoft MVP - Excel
Southampton, England
(e-mail address removed)
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Top