Details
-
Improvement
-
Status: Resolved
-
Trivial
-
Resolution: Duplicate
-
None
-
None
-
None
Description
Currently many options for loading/saving Parquet need to be set globally on the SparkContext. It would be useful to also provide support for setting these options through the DataFrameReader/DataFrameWriter.
Attachments
Issue Links
- duplicates
-
SPARK-14913 Simplify configuration API
- Resolved
- is related to
-
SPARK-13543 Support for specifying compression codec for Parquet/ORC via option()
- Resolved