Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3173 Reduce catalog's memory footprint
  3. IMPALA-6390

Prefer binary over string in catalog thrift definitions

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • Impala 2.11.0
    • None
    • Catalog
    • None
    • ghx-label-6

    Description

      When a String is serialized/deserialized in thrfit, it will be encoded/copied several times. It consumes both time and memory.
      Catalog server stores most information as-is without caring about the encoding or doing any operation on the string. Thus, we should use binary (byte[] in Java) in thrift unless a field is defined as string by HMS.

      Attachments

        Activity

          People

            tianyiwang Tianyi Wang
            tianyiwang Tianyi Wang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: