Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4
    • Component/s: replication (java)
    • Labels:
      None

      Description

      From a discussion on the mailing list solr-user, it would be useful to have an option to compress the files sent between servers for replication purposes.

      Files sent across between indexes can be compressed by a large margin allowing for easier replication between sites.

      ...Noted by Noble Paul

      we will use a gzip on both ends of the pipe . On the slave side you can say <str name="zip">true<str> as an extra option to compress and send data from server

      Other thoughts on issue:

      Do keep in mind that compression is a CPU intensive process so it is a trade off between CPU utilization and network bandwidth. I have see cases where compressing the data before a network transfer ended up being slower than without compression because the cost of compression and un-compression was more than the gain in network transfer.

      Why invent something when compression is standard in HTTP? --wunder

      1. solr-829.patch
        3 kB
        Akshay K. Ukey
      2. solr-829.patch
        5 kB
        Noble Paul
      3. solr-829.patch
        7 kB
        Akshay K. Ukey
      4. solr-829.patch
        18 kB
        Shalin Shekhar Mangar
      5. email discussion.txt
        6 kB
        Simon Collins

        Issue Links

          Activity

          Simon Collins created issue -
          Simon Collins made changes -
          Field Original Value New Value
          Attachment email discussion.txt [ 12392991 ]
          Hoss Man made changes -
          Component/s replication (java) [ 12312535 ]
          Component/s replication (scripts) [ 12311446 ]
          Affects Version/s 1.3.1 [ 12313422 ]
          Noble Paul made changes -
          Link This issue is related to SOLR-561 [ SOLR-561 ]
          Akshay K. Ukey made changes -
          Attachment solr-829.patch [ 12393685 ]
          Shalin Shekhar Mangar made changes -
          Assignee Shalin Shekhar Mangar [ shalinmangar ]
          Noble Paul made changes -
          Link This issue is blocked by SOLR-856 [ SOLR-856 ]
          Noble Paul made changes -
          Attachment solr-829.patch [ 12394039 ]
          Akshay K. Ukey made changes -
          Attachment solr-829.patch [ 12394359 ]
          Noble Paul made changes -
          Link This issue is blocked by SOLR-856 [ SOLR-856 ]
          Noble Paul made changes -
          Link This issue relates to SOLR-856 [ SOLR-856 ]
          Shalin Shekhar Mangar made changes -
          Attachment solr-829.patch [ 12394405 ]
          Shalin Shekhar Mangar made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Fix Version/s 1.4 [ 12313351 ]
          Grant Ingersoll made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Shalin Shekhar Mangar
              Reporter:
              Simon Collins
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development