Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
tez-branch
-
None
-
ZeroCopy readers for the ORC file format
Description
ORC can use the new HDFS Caching APIs and the ZeroCopy readers to avoid extra data copies into memory while scanning files.
Implement ORC zcr codepath and a hive.orc.zerocopy flag.
Attachments
Attachments
Issue Links
- blocks
-
HIVE-6382 PATCHED_BLOB encoding in ORC will corrupt data in some cases
- Resolved
- is blocked by
-
HIVE-6346 Add Hadoop-2.4.0 shims to hive-tez
- Resolved
-
HADOOP-10047 Add a directbuffer Decompressor API to hadoop
- Closed
- is related to
-
HIVE-6360 Hadoop 2.3 + Tez 0.3
- Resolved
-
HDFS-4949 Centralized cache management in HDFS
- Closed
-
HDFS-5957 Provide support for different mmap cache retention policies in ShortCircuitCache.
- Resolved