GNOME Bugzilla – Bug 700294
statfuns -- increase accuracy requirement
Last modified: 2013-05-15 13:52:47 UTC
We should increase the accuracy requirement in statfuns.xls to something stronger -- maybe 10 correct digits. Just changing it causes us to fail various cdf inverse-cdf tests because the reference values we have are from Excel cirka 1997. Current Excel fails those too. We need reference values from a trusted third party.
We agree with Excels values up to at least 1e-13 relative error. Given the other tests we have for the stats functions -- Yalta and Burkardt, for example, that's good enough to trust these values.