If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.

 
Go Back  dBforums > PC based Database Applications > Microsoft Excel > Hidden Decimal Values?

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1 (permalink)  
Old 08-02-11, 11:22
scrtchmstj scrtchmstj is offline
Registered User
 
Join Date: Jan 2009
Location: Louisiana, United States
Posts: 138
Hidden Decimal Values?

Has anyone had any experiences with a hidden decimal value in Excel. I essentially have three numbers with no value beyond the hundredth decimal place that when added yield a sum with a value in the 9th decimal space. The following is what the numbers look like when I copy and paste as values, extend the decimal places to the maximum 30 spaces and sum the 3 numbers.

3,426,429.870000000000000000000000000000 (This value is entered manually)
1,084,762.460000000000000000000000000000 (This comes from a sum formula output)
-5,413,327.380000000000000000000000000000 (This comes from a sum formula output)
-902,135.050000001000000000000000000000

If I manually key in these three numbers and sum them, the trailing decimal value does not show up in the sum. It's just when I copy and paste as value from a formula that apparently a hidden decimal value sneaks in.
Reply With Quote
  #2 (permalink)  
Old 08-02-11, 19:39
Colin Legg Colin Legg is offline
Registered User
 
Join Date: Sep 2008
Location: London, UK
Posts: 495
Yes, this can happen (due to binary computation). You can round the result to n decimal places using one of Excel's rounding functions.
__________________
Colin

RAD Excel Blog

Other tutorials:
Array Formulas | Deleting Rows with VBA
Reply With Quote
  #3 (permalink)  
Old 08-03-11, 10:13
scrtchmstj scrtchmstj is offline
Registered User
 
Join Date: Jan 2009
Location: Louisiana, United States
Posts: 138
Jeesh, that's kind of junk. No big problem with my situation rounding but if I was working with numbers with extended decimal spaces I would question the accuracy. It's just strange that the number displayed may differ from the number used if you referrence that cell in a formula.
Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On