Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-16848

Check schema validation for user-specified schema in jdbc and table APIs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Trivial
    • Resolution: Fixed
    • 2.0.0
    • 2.2.0
    • SQL
    • None

    Description

      Currently,

      Both APIs below:

      spark.read.schema(StructType(Nil)).jdbc(...)
      

      and

      spark.read.schema(StructType(Nil)).table("usrdb.test")
      

      ignore schemas.

      It'd make sense to throw an exception rather than causing confusion to users.

      Attachments

        Issue Links

          Activity

            People

              hyukjin.kwon Hyukjin Kwon
              hyukjin.kwon Hyukjin Kwon
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: