Uploaded image for project: 'Commons Math'
  1. Commons Math
  2. MATH-1131

Kolmogorov-Smirnov Tests takes 'forever' on 10,000 item dataset

Rank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.3
    • 3.4
    • None
    • None
    • Java 8

    Description

      I have code simplified to the following:

      KolmogorovSmirnovTest kst = new KolmogorovSmirnovTest();
      NormalDistribution nd = new NormalDistribution(mean,stddev);
      kst.kolmogorovSmirnovTest(nd,dataset)

      I find that for my dataset of 10,000 items, the call to kolmogorovSmirnovTest takes 'forever'. It has not returned after nearly 15minutes and in one my my tests has gone over 150MB in memory usage.

      Attachments

        1. 1.txt
          36 kB
          Schalk W. Cronjé
        2. MATH-1131.patch
          6 kB
          Thomas Neidhart
        3. ReproduceKsIssue.groovy
          0.5 kB
          Schalk W. Cronjé
        4. ReproduceKsIssue.java
          1 kB
          Schalk W. Cronjé

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            ysb33r Schalk W. Cronjé
            Votes:
            2 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment