Bulk Operation

SPARK-27589 File source V2: support bucketing

SPARK-27589 Add V1/V2 tests for TextSuite and WholeTextFileSuite

SPARK-27589 File source V2: Support partition pruning with subqueries

SPARK-27589 Disable all the V2 file sources in Spark 3.0 by default

SPARK-27589 File source V2: support partition pruning

SPARK-27589 Add PathCatalog for data source V2

SPARK-27589 Migrate Avro to File source V2

SPARK-27589 useV1SourceList configuration should be for all data sources

SPARK-27589 File source v2: support reading output of file streaming Sink

SPARK-27589 Allow altering table add columns with CSVFileFormat/JsonFileFormat provider

SPARK-27589 Redact treeString of FileTable and DataSourceV2ScanExecBase

SPARK-27589 File source V2: support reporting statistics

SPARK-27589 Implement `doCanonicalize` in BatchScanExec for comparing query plan results

SPARK-27589 File source V2: support refreshing metadata cache

SPARK-27589 File source V2: return correct result for Dataset.inputFiles()

SPARK-27589 Revise the exception message of schema inference failure in file source V2

SPARK-27589 File source V2 table provider should be compatible with V1 provider

SPARK-27589 Support UDF input_file_name in file source V2

SPARK-27589 Support schema pruning in Orc V2

SPARK-27589 Migrate Parquet to File Data Source V2

SPARK-27589 File source V2: Invalidate cache data on overwrite/append

SPARK-27589 File source V2: Prune unnecessary partition columns

SPARK-27589 File source V2: return actual schema in method `FileScan.readSchema`

SPARK-27589 Fall back all v2 file sources in `InsertIntoTable` to V1 FileFormat

SPARK-27589 File source V2: Ignore empty files in load

SPARK-27589 Handles exceptions on proceeding to next record in FilePartitionReader

SPARK-27589 Migrate Text to File Data Source V2

SPARK-27589 File source v2 should validate data schema only

SPARK-27589 Remove data source option check_files_exist

SPARK-27589 Improve file source V2 framework

SPARK-27589 Migrate JSON to File Data Source V2

SPARK-27589 Migrate CSV to File Data Source V2

SPARK-27589 Support handling partition values in the abstraction of file source V2

SPARK-27589 File Source V2: avoid creating unnecessary FileIndex in the write path

SPARK-27589 Support schema validation in File Source V2

SPARK-27589 File source V2 write: create framework and migrate ORC to it

SPARK-27589 Allow OrcColumnarBatchReader to return less partition columns

SPARK-27589 Create file source V2 framework and migrate ORC read path