Lucene - Core
  1. Lucene - Core
  2. LUCENE-648

Allow changing of ZIP compression level for compressed fields

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Won't Fix
    • Affects Version/s: 1.9, 2.0.0, 2.1
    • Fix Version/s: None
    • Component/s: core/index
    • Labels:
      None

      Description

      In response to this thread:

      http://www.gossamer-threads.com/lists/lucene/java-user/38810

      I think we should allow changing the compression level used in the call to java.util.zip.Deflator in FieldsWriter.java. Right now it's hardwired to "best":

      compressor.setLevel(Deflater.BEST_COMPRESSION);

      Unfortunately, this can apparently cause the zip library to take a very long time (10 minutes for 4.5 MB in the above thread) and so people may want to change this setting.

      One approach would be to read the default from a Java system property, but, it seems recently (pre 2.0 I think) there was an effort to not rely on Java System properties (many were removed).

      A second approach would be to add static methods (and static class attr) to globally set the compression level?

      A third method would be in document.Field class, eg a setCompressLevel/getCompressLevel? But then every time a document is created with this field you'd have to call setCompressLevel since Lucene doesn't have a global Field schema (like Solr).

      Any other ideas / prefererences for either of these methods?

        Activity

        Michael McCandless created issue -
        Grant Ingersoll made changes -
        Field Original Value New Value
        Resolution Won't Fix [ 2 ]
        Status Open [ 1 ] Resolved [ 5 ]
        Grant Ingersoll made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Mark Thomas made changes -
        Workflow jira [ 12381489 ] Default workflow, editable Closed status [ 12563427 ]
        Mark Thomas made changes -
        Workflow Default workflow, editable Closed status [ 12563427 ] jira [ 12584205 ]

          People

          • Assignee:
            Unassigned
            Reporter:
            Michael McCandless
          • Votes:
            1 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development