Issue 91100 - Display error with scientific format and 14 decimals on Windows and Solaris/Sparc
Summary: Display error with scientific format and 14 decimals on Windows and Solaris/S...
Status: CONFIRMED
Alias: None
Product: Calc
Classification: Application
Component: formatting (show other issues)
Version: DEV300m19
Hardware: All All
: P3 Trivial (vote)
Target Milestone: ---
Assignee: AOO issues mailing list
QA Contact:
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2008-06-26 14:58 UTC by ooo
Modified: 2020-07-26 19:43 UTC (History)
3 users (show)

See Also:
Issue Type: DEFECT
Latest Confirmation in: ---
Developer Difficulty: ---

Attachments
simple examples without function call but only addition (12.60 KB, application/vnd.oasis.opendocument.spreadsheet)
2008-06-26 17:03 UTC, Regina Henschel 		no flags Details
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this issue.
Description ooo 2008-06-26 14:58:11 UTC 
In a cell enter the formula =1-7E-16 and format the cell with a scientific
format of 0.00000000000000E+000

Displayed is 10.00000000000000E+000 instead of 9.99999999999999E-001 (would be
1.00000000000000E+000 if rounded up).

A smaller amount of decimals in the format code displays fine. A larger amount
of decimals continues to display 10. This occurs on Windows and Solaris/Sparc,
but not on Linux/x86. Other values around =1-7E-16 also seem to display fine.
Comment 1 Regina Henschel 2008-06-26 17:03:48 UTC 
Created attachment 54771 [details]
simple examples without function call but only addition
Comment 2 Regina Henschel 2008-06-26 17:05:42 UTC 
I see the error in SO7PU12, OOo2.3.1, OOo2.4.1, and DEV300m20. I use WinXP.
Comment 3 Regina Henschel 2008-07-13 17:35:52 UTC 
Convert the numbers to binary. Then you get
wrong display:
0.111111111111111111111111111111111111111111111111110100000000

correct display:
0.111111111111111111111111111111111111111111111111110110000000
0.111111111111111111111111111111111111111111111111110010000000
Comment 4 ooo 2009-01-21 23:34:04 UTC 
Won't make it for 3.1, targeting to 3.2
Comment 5 ooo 2009-11-13 13:35:47 UTC 
OOo3.2 is in show-stopper stage, re-targeting.
Comment 6 Marcus 2017-05-20 11:11:09 UTC 
Reset assigne to the default "issues@openoffice.apache.org".
Comment 7 b. 2020-07-26 19:43:08 UTC 
twelve years now? and nobody took this bug? 

it's no fun to get a result *off by a factor of ten!* by a spreadsheet ... 

could someone provide a code pointer where in this overwhelming big suite that formatting is done?