Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-5316

Potential bug with Fetch Parquet

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.6.0
    • 1.8.0, 1.7.1
    • None
    • None

    Description

      I have used PutParquet to create Parquet files from Nifi Records.  In trying to convert the parquet back to json by using FetchParquet, I keep getting errors on what seems like any array field.  I have had successes on data that contained no arrays.

      The error in the log is cannont convert a value [xxx, yyy] where xxx and yyy are random strings of type class java.util.ArrayList because no compatible type exist in the UNION of field z.

      I am also see the same error when the value is [] (empty array) as well.  

      I have been successful gong from json to avro and avro to json with the same schema registry values.

      I am defining array fields as follows:

      "type" : [

        "null",

       

      {       "type" : "array",        "items" : "string" }

      ],

      "default": null

      }

       

       

      Attachments

        Issue Links

          Activity

            People

              bbende Bryan Bende
              rbruno Robert Bruno
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: