Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-2978

Upgrade benchmark from commons-compress-1.0 to commons-compress-1.1 for 15 times faster gzip decompression

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.2, 4.0-ALPHA
    • Component/s: modules/benchmark
    • Labels:
      None

      Description

      In LUCENE-1540 TrecContentSource moved from Java's GZipInputStream to common-compress 1.0.
      This slowed down gzip decompression by a factor of 15.
      Upgrading to 1.1 solves this problem.
      I verified that the problem is only in GZIP, not in BZIP.
      On the way, as 1.1 introduced constants for the compression methods, the code can be made a bit nicer.

        Attachments

          Activity

            People

            • Assignee:
              doronc Doron Cohen
              Reporter:
              doronc Doron Cohen

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment