Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2483

HiveQL parses accessing struct fields in an array incorrectly.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.0.2, 1.1.0
    • SQL
    • None

    Description

      Test case:

      case class Data(a: Int, B: Int, n: Nested, nestedArray: Seq[Nested])
      case class Nested(a: Int, B: Int)
      
        test("nested repeated resolution") {
          TestHive.sparkContext.parallelize(Data(1, 2, Nested(1,2), Seq(Nested(1,2))) :: Nil)
            .registerAsTable("nestedRepeatedTest")
          hql("SELECT nestedArray[0].a FROM nestedRepeatedTest").collect()
        }
      

      Attachments

        Activity

          People

            marmbrus Michael Armbrust
            marmbrus Michael Armbrust
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: