Precision in formulas?

C

Chris W

I have a formula as follows:
C1=A1*B1 (assume A1=$482,933 and B1=0.9695)
My expected result is $468,203. However the actual result shown in C1 is
$468,181.
It appears as though the value used in B1 to derive the result is accurate
to a greater precision (i.e. 0.9695?????) than the 4 decimal places displayed
in cell B1.
Is there a way I can force the formula to use a specfic precision or some
other solution to my porblem?
TIA. Chris.
 
D

David Billigmeier

C1=A1*ROUND(B1,4)

-OR-

<Tools><Options>
Calculation Tab
Check "Precision as displayed"... This option will use the precision as
displayed in the cell to calculate on, instead of the actual value stored in
that cell.

Does that help?
 
T

tony h

Always difficult using binary for decimal calculations. Who remembers
BCD?

You will find your answer in a formula such as
=ROUND(A9*ROUND(B9,4),0)

but whether you use round , rounddown, int, floor, ceiling etc really
depends on your data

hope this helps
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Top