-
Type:
Improvement
-
Status: Closed
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: None
-
Fix Version/s: 1.5.0
-
Component/s: None
-
Labels:None
HDFS-3689 added variable length blocks to HDFS as a core feature.
hsync(SyncFlag.END_BLOCK)
can now end an HDFS block on disk without padding it out with zeros.
The current space wasted in ORC to padding is 5%.