Details
-
New Feature
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
As for now, PXF has HiveORC format which supports reading ORC files with leveraging ORC's file advantages(column projections, predicate push-downs).
The only drawback of this profile - it still operates on a single row. So the idea is to implement a profile for reading ORC files, but operate on batches of rows, which supposed to be faster on reading and resolution phases.