Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
0.10.0, 0.11.0, 0.12.0
-
(Columnar pushdown will now work with HCatLoader - basically, what this means is that when using RC/ORC tables, not all rows are necessarily read and processed if pig would discard (by filtering) it anyway. This allows reads to be a bit faster.)
-
hcatalog, columnar pushdown
Description
Currently the HCatLoader is not taking advantage of the ColumnProjectionUtils. where it could skip columns during read. The information is available in Pig it just needs to get to the Readers.
Viraj
Attachments
Attachments
Issue Links
- is superceded by
-
HIVE-12006 Enable Columnar Pushdown for RC/ORC File for HCatLoader
- Closed
- relates to
-
HIVE-10755 Rework on HIVE-5193 to enhance the column oriented table access
- Closed