Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8454

Recursively list files within transactional tables

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: Impala 3.3.0
    • Component/s: Catalog
    • Labels:
    • Epic Link:
    • Docs Text:
      Files will now be listed recursively within tables. This improves compatibility with Hive-on-Tez and other execution engines.
    • Epic Color:
      ghx-label-6

      Description

      For transactional tables, the data files are not directly within the partition directories, but instead are stored within subdirectories corresponding to writeIds, compactions, etc. To support this, we need to be able to recursively load file lists within partition directories.

        Attachments

          Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-1944 Unable to read data from recursive directories as table location

          • Major - Major loss of function.
          • Resolved
          relates to

          Task - A task that needs to be done. IMPALA-8511 Impala Doc: Incompatible changes in Impala 3.3

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                tlipcon Todd Lipcon
                Reporter:
                tlipcon Todd Lipcon
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: