10.5 What's this about the 15 digit numbers that return 0.64 or 1.28? (spreadsheets: Excel)
Description
This article is from the Spreadsheets
FAQ, by Russell Schulz casfaq@locutus.ofB.ORG with numerous
contributions by others.
10.5 What's this about the 15 digit numbers that return 0.64 or 1.28? (spreadsheets: Excel)
according to Microsoft, the problem numbers are:
> 140737488355328 = 2^47
> 281474976710656 = 2^48
> 562949953421312 = 2^49
> multiples of ten also cause problems, such as 1.40737488355328
see http://support.microsoft.com/support/kb/articles/q128/6/50.asp
see ftp://ftp.microsoft.com/deskapps/excel/kb/q128/6/
see http://support.microsoft.com/support/kb/articles/q128/3/32.asp
see ftp://ftp.microsoft.com/deskapps/excel/kb/q128/3/
 
Continue to: