Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23553

Tests should not assume the default value of `spark.sql.sources.default`

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.3.1, 2.4.0
    • Tests
    • None

    Description

      Currently, some tests have an assumption that `spark.sql.sources.default=parquet`. In fact, that is a correct assumption, but that assumption makes it difficult to test new data source format. This issue improves test suites more robust and makes it easy to test new data sources. As an example, the PR will use `spark.sql.sources.default=orc` during reviews.

      Attachments

        Activity

          People

            dongjoon Dongjoon Hyun
            dongjoon Dongjoon Hyun
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: