W
Wayne Knazek via OfficeKB.com
Unique situation. Customer does not want our values "rounded" to 3 places.
They want them "truncated" to 3 places, without regard to the 4th decimal
place.
(Note: I know truncate is the incorrect function. But that's what they said.
I know
what they really want.)
To clarify . . .
One column pulls measured data from our data base as . . .
1.2508794
1.2504556
1.2499987
1.2500124
etc.
They want to "see" & use in calcs . . .
1.250
1.250
1.249
1.250
Rounding to 3 places would work for 2 of the above entries, but not 1.2508794
or 1.2499987. They would round to 1.251 and 1.250.
I need to do this for 3 columns, then do some minor calcs using the 3 columns.
So the values I use must also be the 3 decimal "un-rounded" values.
Yeah, seems strange. This study is checking some values, assuming the
accuracy of a machine to only be 3 places. They don't want the 4th place to
effect the 3rd decimal place.
So I have 3 columns of data now. (one set of columns for one dimension)
Nominal, actual reading and upper tolerance. I need to perform a function to
get each column formatted as listed above. And do it for a couple hundred
"sets" in this study. The Nom and Tolerance column is no issue. But
reformatting the actual data?
1). I can't figure out how to just use 3 decimal places without rounding.
This is what I "should" end up with . . .
Nominal Upper Tolerance Actual New Actual
1.250 .010 1.2508794 1.250
1.250 .010 1.2504556 1.250
1.250 .010 1.2499987 1.249
1.250 .010 1.2500124 1.250
2). Will I need to insert an extra column (New Actual) next to each "Actual"
column. Then perform the same function to the Actual column for each New
Actual column. Doing this 200 times will be quite a chore. Then I have to
do it for 2 other data sets, one is 60 times, one is 42 times.
Any ideas would be most appreciated.
I'm not asking for a hand out. But I really can't get this to work. Hmmmm.
They want them "truncated" to 3 places, without regard to the 4th decimal
place.
(Note: I know truncate is the incorrect function. But that's what they said.
I know
what they really want.)
To clarify . . .
One column pulls measured data from our data base as . . .
1.2508794
1.2504556
1.2499987
1.2500124
etc.
They want to "see" & use in calcs . . .
1.250
1.250
1.249
1.250
Rounding to 3 places would work for 2 of the above entries, but not 1.2508794
or 1.2499987. They would round to 1.251 and 1.250.
I need to do this for 3 columns, then do some minor calcs using the 3 columns.
So the values I use must also be the 3 decimal "un-rounded" values.
Yeah, seems strange. This study is checking some values, assuming the
accuracy of a machine to only be 3 places. They don't want the 4th place to
effect the 3rd decimal place.
So I have 3 columns of data now. (one set of columns for one dimension)
Nominal, actual reading and upper tolerance. I need to perform a function to
get each column formatted as listed above. And do it for a couple hundred
"sets" in this study. The Nom and Tolerance column is no issue. But
reformatting the actual data?
1). I can't figure out how to just use 3 decimal places without rounding.
This is what I "should" end up with . . .
Nominal Upper Tolerance Actual New Actual
1.250 .010 1.2508794 1.250
1.250 .010 1.2504556 1.250
1.250 .010 1.2499987 1.249
1.250 .010 1.2500124 1.250
2). Will I need to insert an extra column (New Actual) next to each "Actual"
column. Then perform the same function to the Actual column for each New
Actual column. Doing this 200 times will be quite a chore. Then I have to
do it for 2 other data sets, one is 60 times, one is 42 times.
Any ideas would be most appreciated.
I'm not asking for a hand out. But I really can't get this to work. Hmmmm.