Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6838

Compress metadata in DDL operations

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • Impala 3.0, Impala 2.12.0
    • None
    • Catalog
    • None
    • ghx-label-2

    Description

      After IMPALA-5990, the catalog metadata sent through catalogd -> statestored -> imapald is compressed. But the responses of DDL operations, which goes directly from catalogd to impalad, is not compressed, and the data transmission between Java and C++ is still bounded by the 2GB limit. We should compress it as well to save network bandwidth and improve impala's capability to handle large metadata.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-5990 End-to-end compression of metadata

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              tianyiwang Tianyi Wang
              tianyiwang Tianyi Wang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: