Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-40705

Issue with spark converting Row to Json using Scala 2.13

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.0
    • 3.3.1, 3.4.0
    • SQL
    • None

    Description

      Note: This issue can be reproduced only using Scala 2.13

      When I'm trying to convert the Row to a json to publish it, i'm getting this following error

      I tried to investigate and I found that the issue is in the matching.

      The type `ArraySeq` is not matched in `Row` class.

      This is the definition of my field

      And an example of it 

       

      {
      ...
      Codes: ["Test", "Spark", "Json"]
      ...
      }

      The Scala version I'm using is `2.13.9`

      Attachments

        1. image-2022-10-07-19-44-09-972.png
          26 kB
          Amrane Ait Zeouay
        2. image-2022-10-07-19-44-00-332.png
          179 kB
          Amrane Ait Zeouay
        3. image-2022-10-07-19-43-51-892.png
          141 kB
          Amrane Ait Zeouay
        4. image-2022-10-07-19-43-42-232.png
          58 kB
          Amrane Ait Zeouay

        Activity

          People

            Amraneze Amrane Ait Zeouay
            Amraneze Amrane Ait Zeouay
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: