Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3173 Reduce catalog's memory footprint
  3. IMPALA-6390

Prefer binary over string in catalog thrift definitions

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: Impala 2.11.0
    • Fix Version/s: None
    • Component/s: Catalog
    • Labels:
      None
    • Epic Color:
      ghx-label-6

      Description

      When a String is serialized/deserialized in thrfit, it will be encoded/copied several times. It consumes both time and memory.
      Catalog server stores most information as-is without caring about the encoding or doing any operation on the string. Thus, we should use binary (byte[] in Java) in thrift unless a field is defined as string by HMS.

        Attachments

          Activity

            People

            • Assignee:
              tianyiwang Tianyi Wang
              Reporter:
              tianyiwang Tianyi Wang
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: