Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-1083

allow sub-directories for an external table/partition

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.6.0
    • None
    • Query Processor

    Description

      Sometimes users want to define an external table/partition based on all files (recursively) inside a directory.

      Currently most of the Hadoop InputFormat classes do not support that. We should extract all files recursively in the directory, and add them to the input path of the job.

      Attachments

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-1133 Refactor InputFormat and OutputFormat for Hive

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-1501 FileInputFormat to support multi-level/recursive directory listing

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-951 Selectively include EXTERNAL TABLE source files via REGEX

          • Major - Major loss of function.
          • Open
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HIVE-1662 Add file pruning into Hive.

          • Major - Major loss of function.
          • Patch Available

          Activity

            People

              zshao Zheng Shao
              namit Namit Jain
              Votes:
              18 Vote for this issue
              Watchers:
              25 Start watching this issue

              Dates

                Created:
                Updated: