Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9810

Support Kudu's columnar scan format (Apache Arrow)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Backend
    • ghx-label-4

    Description

      Starting in Kudu 1.12 Kudu supports a columnar wire format that is Apache Arrow compatible. This format is significantly more efficient and faster than the row based format. Impala should support the columnar format, optimally operating on the arrow/columnar format natively.

      Of course using the columnar format natively is the best end result, but it might be beneficial enough to translate to the row based format client side. The Java client recently added a patch for this https://gerrit.cloudera.org/#/c/15983/ and Kudu could add similar C++ client functionality if needed.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              granthenke Grant Henke
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: