Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5193

Columnar Pushdown for RC/ORC File not happening in HCatLoader

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.10.0, 0.11.0, 0.12.0
    • 0.13.0
    • HCatalog
    • (Columnar pushdown will now work with HCatLoader - basically, what this means is that when using RC/ORC tables, not all rows are necessarily read and processed if pig would discard (by filtering) it anyway. This allows reads to be a bit faster.)
    • hcatalog, columnar pushdown

    Description

      Currently the HCatLoader is not taking advantage of the ColumnProjectionUtils. where it could skip columns during read. The information is available in Pig it just needs to get to the Readers.
      Viraj

      Attachments

        1. HIVE-5193.2.patch
          5 kB
          Viraj Bhat
        2. HIVE-5193.patch
          5 kB
          Viraj Bhat

        Issue Links

          is superceded by

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-12006 Enable Columnar Pushdown for RC/ORC File for HCatLoader

          • Major - Major loss of function.
          • Closed
          relates to

          Sub-task - The sub-task of the issue HIVE-10755 Rework on HIVE-5193 to enhance the column oriented table access

          • Major - Major loss of function.
          • Closed

          Activity

            People

              viraj Viraj Bhat
              viraj Viraj Bhat
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: