Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8454

Recursively list files within transactional tables

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: Impala 3.3.0
    • Component/s: Catalog
    • Labels:
    • Docs Text:
      Files will now be listed recursively within tables. This improves compatibility with Hive-on-Tez and other execution engines.
    • Epic Color:
      ghx-label-6

      Description

      For transactional tables, the data files are not directly within the partition directories, but instead are stored within subdirectories corresponding to writeIds, compactions, etc. To support this, we need to be able to recursively load file lists within partition directories.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                tlipcon Todd Lipcon
                Reporter:
                tlipcon Todd Lipcon
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: