Description
SPARK-20682 is trying to improve Apache Spark to have a new ORCFileFormat based on Apache ORC for many reasons.
This issue depends on SPARK-20682 and aims to provide a configuration to choose the default ORCFileFormat from legacy `sql/hive` module or new `sql/core` module.
For example, this configuration will affects the following operations.
spark.read.orc(...)
CREATE TABLE t USING ORC ...
Attachments
Attachments
Issue Links
- blocks
-
SPARK-20901 Feature parity for ORC with Parquet
- Open
- is blocked by
-
SPARK-21422 Depend on Apache ORC 1.4.0
- Resolved
-
SPARK-20682 Add new ORCFileFormat based on Apache ORC
- Resolved
- supercedes
-
SPARK-19109 ORC metadata section can sometimes exceed protobuf message size limit
- Resolved
- links to