Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
Rows in partitions are now read using partition schema and than made to comply with table schema, instead of being read directly using table schema.
Description
Currently, different partitions can be picked up for the same input split based on the
serdes' etc. And, we dont allow to change the schema for LazyColumnarBinarySerDe.
Instead of that, different partitions should be part of the same split, only if the
partition schemas exactly match. The operator tree object inspectors should be based
on the partition schema. That would give greater flexibility and also help using binary serde with rcfile
