Issue 88972 - XY (scatter) with large numbers goes wrong
Summary: XY (scatter) with large numbers goes wrong
Status: CLOSED FIXED
Alias: None
Product: General
Classification: Code
Component: chart (show other issues)
Version: 3.3.0 or older (OOo)
Hardware: All All
: P3 Trivial (vote)
Target Milestone: ---
Assignee: kla
QA Contact: issues@graphics
URL:
Keywords: oooqa, regression
Depends on:
Blocks: 72764
  Show dependency tree
 
Reported: 2008-05-03 17:28 UTC by openoffice.org
Modified: 2013-02-24 21:19 UTC (History)
4 users (show)

See Also:
Issue Type: DEFECT
Latest Confirmation in: ---
Developer Difficulty: ---

Attachments
example with wrong scaling (11.56 KB, application/vnd.oasis.opendocument.spreadsheet)
2008-05-06 09:10 UTC, IngridvdM 		no flags Details
patch_080515 (1.19 KB, text/plain)
2008-05-22 03:33 UTC, weiz 		no flags Details
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this issue.
Description openoffice.org 2008-05-03 17:28:27 UTC 
I was curious when I came across this document whether Calc had the same flaws
as Excel: http://www.mis.coventry.ac.uk/~nhunt/pottel.pdf

stdev is perfect in calc, but it goes wrong with the scatter plot:


steps to reproduce:
1. create a new document with these numbers

10000000001	1000000000
10000000002	1000000000
10000000003	1000000000.9
10000000004	1000000001.1
10000000005	1000000001.01
10000000006	1000000000.99
10000000007	1000000001.1
10000000008	1000000001
10000000009	1000000000
10000000010	1000000000

2. create a new chart object with xy scatter 
3. output is a plot with negative numbers?

Expected:

A good plot (see document, p. 7)
Comment 1 Regina Henschel 2008-05-03 17:55:57 UTC 
Confirm, the automatic sets wrong values to y-axis.
Comment 2 kla 2008-05-05 10:19:45 UTC 
confirmed, reassign to IHA
Comment 3 IngridvdM 2008-05-06 09:10:56 UTC 
Created attachment 53405 [details]
example with wrong scaling
Comment 4 weiz 2008-05-22 03:32:02 UTC 
->iha: the patch is finished, please let me know your suggestions. Thanks!
Comment 5 weiz 2008-05-22 03:33:02 UTC 
Created attachment 53832 [details]
patch_080515
Comment 6 IngridvdM 2008-06-05 10:11:45 UTC 
@weiz, thanks for finding the root cause! Your patch does fix this problem.
There is still a possibility to enhance the fix. Instead of switching only from
sal_Int32 to sal_In64 we can use type double and function floor. Thus the fix
will help for even more extreme values. I changed the code accordingly in CWS
chart27.
Comment 7 IngridvdM 2008-06-05 10:15:10 UTC 
Fixed in CWS chart27.
Comment 8 IngridvdM 2008-06-25 12:24:32 UTC 
@Thomas, please verify in CWS chart27.
For all old files including the attached one it is necessary to double click the
chart once or update it otherwise (e.g. by pressing F9) to see the corrected
rendering.
Comment 9 kla 2008-06-27 10:04:27 UTC 
Seen ok in CWS chart27 -> verified
Comment 10 kla 2008-07-22 13:52:24 UTC 
Seen ok in current master -> closed