Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-6241

ConvertRecord Schema Inference fails to infer complete schema, or simply fails

Agile BoardAttach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.9.2
    • None
    • Core Framework
    • None

    Description

      I've got a simple test flow as depicted below:

       

       

       

      The input XML is:

       

      The output JSON is almost correct, yet it is missing two critical fields (they both show up as "null". The null fields are position and ncsmTrackData. It is also missing all of the attributes on fltdMessage.

       

       

      The configuration of my ConvertRecord is:

       

      My XMLReader configuration is:

       

       Questions:

      1. Why are these two fields null? 
      2. Why are all the fltdMessage attributes being ignored?

      It would seem that this is a bug, or at least a major shortcoming, in the schema inference capability. If there were a way for me to view the inferred schema, then I could use that as a starting point. However its not clear from the documentation how to view that schema.

       

      Attachments

        1. image-2019-05-20-09-01-02-488.png
          56 kB
          David Sargrad
        2. image-2019-04-25-09-30-08-297.png
          67 kB
          David Sargrad
        3. image-2019-04-25-09-19-15-406.png
          143 kB
          David Sargrad
        4. image-2019-04-25-09-13-52-416.png
          96 kB
          David Sargrad
        5. image-2019-04-24-17-03-10-728.png
          29 kB
          David Sargrad
        6. Reproduce_ConvertRecord_Shortcoming.xml
          66 kB
          David Sargrad
        7. image-2019-04-24-13-43-59-706.png
          53 kB
          David Sargrad
        8. image-2019-04-24-13-43-28-531.png
          22 kB
          David Sargrad
        9. image-2019-04-24-13-41-26-860.png
          135 kB
          David Sargrad
        10. image-2019-04-24-13-41-00-704.png
          32 kB
          David Sargrad
        11. image-2019-04-24-13-39-36-327.png
          116 kB
          David Sargrad
        12. image-2019-04-24-13-38-16-605.png
          100 kB
          David Sargrad

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            dsargrad David Sargrad

            Dates

              Created:
              Updated:

              Slack

                Issue deployment