Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-44873

Alter nested view fails because of HMS client

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0, 3.1.1, 3.1.2, 3.2.0, 3.1.3, 3.2.1, 3.3.0, 3.2.2, 3.3.1, 3.2.3, 3.2.4, 3.3.3, 3.4.2, 3.3.2, 3.4.0, 3.4.1, 3.5.0, 3.5.1, 3.3.4
    • 3.5.0, 4.0.0
    • SQL
    • None

    Description

      Currently, 

      CREATE OR REPLACE VIEW t AS SELECT " +
              "struct(id AS `$col2`, struct(id AS `$col`) AS s1) AS s2 FROM RANGE(5)
      ALTER VIEW t SET TBLPROPERTIES ('x' = 'y')

      would fail when calling HMS's updateTable, because HMS does not support nested struct in view. We can fix this by passing HMS an empty schema, since we store the actual view schema in the table's properties already. This fix is similar to https://github.com/apache/spark/pull/37364

      Attachments

        Activity

          People

            kyle.rong Kyle Rong
            kyle.rong Kyle Rong
            Gengliang Wang Gengliang Wang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: