Uploaded image for project: 'Commons Math'
  1. Commons Math
  2. MATH-849

Precision improvement in class Gamma

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.1

      Description

      New unit tests (see below) show that (on the set of values tested) the current accuracy of Gamma.logGamma(double) is about 130 ulps.

      The NSWC Library of Mathematical Functions proposes an implementation of this function with much higher accuracy: on the same set of values, the error goes down to about 3 ulps.

      This library is available here, and is license-free see this thread. It is proposed to port this implementation in Commons-Math. This in turn could lead to a resolution of MATH-738.

        Attachments

        1. MATH-849-Lanczos_vs_NSWC.zip
          33 kB
          Sébastien Brisard
        2. MATH-849.zip
          20 kB
          Sébastien Brisard
        3. MATH-849.patch
          52 kB
          Sébastien Brisard

          Issue Links

            Activity

              People

              • Assignee:
                celestin Sébastien Brisard
                Reporter:
                celestin Sébastien Brisard
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: