After an evaluation, GNOME has moved from Bugzilla to GitLab. Learn more about GitLab.
No new issues can be reported in GNOME Bugzilla anymore.
To report an issue in a GNOME project, go to GNOME GitLab.
Do not go to GNOME Gitlab for: Bluefish, Doxygen, GnuCash, GStreamer, java-gnome, LDTP, NetworkManager, Tomboy.
Bug 700295 - mathfuns -- increase accuracy requirement
mathfuns -- increase accuracy requirement
Status: RESOLVED FIXED
Product: Gnumeric
Classification: Applications
Component: Analytics
git master
Other All
: Normal normal
: ---
Assigned To: Morten Welinder
Jody Goldberg
Depends on:
Blocks:
 
 
Reported: 2013-05-14 13:11 UTC by Morten Welinder
Modified: 2013-05-15 13:12 UTC
See Also:
GNOME target: ---
GNOME version: ---


Description Morten Welinder 2013-05-14 13:11:20 UTC 
We should increase the accuracy requirement in statfuns.xls to something
stronger -- maybe 10 correct digits.

Just changing it causes us to fail SERIESSUM.  Current Excel
similarly fails SERIESSUM and MULTINOMIAL.

We need to verify that we do those two functions right.
Comment 1 Morten Welinder 2013-05-14 13:21:55 UTC 
The only problem with multinomial is that the saved computed values are
not integer.  Current Excel correctly computes these values.
Comment 2 Morten Welinder 2013-05-15 13:12:07 UTC 
Fixed.  1e-13 relative error is the new level, except for tests involving
integer functions where no error is allowed.

Excel fails COMBIN and MULTINOMIAL, but one really has to jump through
hoops to compare two numbers for equality in Excel.  A=B won't do -- that
tests for almost-equality.  A-B=0 does work, at least as a part of a larger
formula.