[SPARK-17369] MetastoreRelation toJSON throws exception

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.0.1, 2.1.0
• Component/s: SQL
• Assignee: Sean Zhong
• Reporter: Sean Zhong
• Created: 01/Sep/16 23:22
• Updated: 06/Sep/16 07:43
• Resolved: 06/Sep/16 07:43

Description

MetastoreRelationSuite.toJSON now throws exception.

test case:

package org.apache.spark.sql.hive

import org.apache.spark.SparkFunSuite
import org.apache.spark.sql.catalyst.TableIdentifier
import org.apache.spark.sql.catalyst.catalog.{CatalogStorageFormat, CatalogTable, CatalogTableType}
import org.apache.spark.sql.types.{IntegerType, StructField, StructType}

class MetastoreRelationSuite extends SparkFunSuite {
  test("makeCopy and toJSON should work") {
    val table = CatalogTable(
      identifier = TableIdentifier("test", Some("db")),
      tableType = CatalogTableType.VIEW,
      storage = CatalogStorageFormat.empty,
      schema = StructType(StructField("a", IntegerType, true) :: Nil))
    val relation = MetastoreRelation("db", "test")(table, null, null)

    // No exception should be thrown
    relation.makeCopy(Array("db", "test"))
    // No exception should be thrown
    relation.toJSON
  }
}

Issue Links

• links to: [Github] Pull Request #14928 (clockfly)
• links to: [Github] Pull Request #14968 (clockfly)