Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-8454

Recursively list files within transactional tables

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • Impala 3.3.0
    • Catalog
    • Files will now be listed recursively within tables. This improves compatibility with Hive-on-Tez and other execution engines.
    • ghx-label-6

    Description

      For transactional tables, the data files are not directly within the partition directories, but instead are stored within subdirectories corresponding to writeIds, compactions, etc. To support this, we need to be able to recursively load file lists within partition directories.

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-1944 Unable to read data from recursive directories as table location

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-11209 Inconsistent results querying tables with subdirectories

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. IMPALA-8511 Impala Doc: Incompatible changes in Impala 3.3

          • Major - Major loss of function.
          • Closed

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: