Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7214

Support predicate pushdown for complex data types in ORCFile

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • File Formats, ORC

    Description

      Currently ORCFile does not support predicate pushdown for complex datatypes like map, array and struct while Parquet does. Came across this during discussion of PIG-3760. Our users have a lot of map and struct (tuple in pig) columns and most of the filter conditions are on them. Would be great to have support added for them in ORC

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. PIG-3760 Predicate pushdown for columnar file formats

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-12898 Hive should support ORC block skipping on nested fields

          • Major - Major loss of function.
          • Open
          relates to

          Sub-task - The sub-task of the issue PIG-4094 Predicate pushdown to support complex data types

          • Major - Major loss of function.
          • Open

          Activity

            People

              ashish-kumar-sharma Ashish Sharma
              rohini Rohini Palaniswamy
              Votes:
              3 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated: