Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Currently, scanners implemented the heap-based codes. so that we met often GC puase.
We should refactor the codes for memory efficient
- change to ByteBuffer-based read scanner
- change to Offheap-based buffer
https://issues.apache.org/jira/browse/HDFS-2834
http://netty.io/wiki/using-as-a-generic-library.html
Attachments
Issue Links
1.
|
Implement direct read of Parquet | Open | Unassigned |