Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8454

Recursively list files within transactional tables

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: Impala 3.3.0
    • Component/s: Catalog
    • Labels:
    • Epic Link:
    • Docs Text:
      Files will now be listed recursively within tables. This improves compatibility with Hive-on-Tez and other execution engines.
    • Epic Color:
      ghx-label-6

      Description

      For transactional tables, the data files are not directly within the partition directories, but instead are stored within subdirectories corresponding to writeIds, compactions, etc. To support this, we need to be able to recursively load file lists within partition directories.

        Attachments

          Issue Links

          relates to

          Task - A task that needs to be done. IMPALA-8511 Impala Doc: Incompatible changes in Impala 3.3

          • Major - Major loss of function.
          • Closed
          There are no Sub-Tasks for this issue.

            Activity

              People

              • Assignee:
                tlipcon Todd Lipcon
                Reporter:
                tlipcon Todd Lipcon
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: