Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-7785

CaptureChangeMySQL processor captures enum values as "INDEX of those values" from Mysql DB"

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.11.4
    • None
    • Tools and Build
    • Ubuntu EC2 instance with 8 GB ram
    • Important

    Description

      CaptureChangeMySQL processor captures enum values as "INDEX of those values" rather than the values specified.

      for example:

      A table has columns (id int, fruit enum ('apple','pears','orange'), price int)

      On doing an insert:

      insert into (1,'apple',45)

      insert into (2,'pears',56)

      I have used CaptureChangeMySql processor to capture the CDC changes, the process does the capture but captures the enum column alone based on its index like the sample below:

      for 1st insert:

       

      {
      "type":"insert",
      "timestamp":1599004442000,
      "binlog_filename":"mysql-bin-changelog.000039",
      "binlog_position":1537835,
      "database":"sample",
      "table_name":"sample",
      "table_id":82,
      "columns":[

      { "id":1, "name":"id", "column_type":-5, "value":139 }

      ,

      { "id":2, "name":"fruit", "column_type":12, "value":0 }

      ,

      { "id":3, "name":"price", "column_type":12, "value":45 }

      ]
      }

       

      for 2nd insert:

       

      {
      "type":"insert",
      "timestamp":1599004442000,
      "binlog_filename":"mysql-bin-changelog.000039",
      "binlog_position":1537835,
      "database":"sample",
      "table_name":"sample",
      "table_id":82,
      "columns":[

      { "id":1, "name":"id", "column_type":-5, "value":139 }

      ,

      { "id":2, "name":"fruit", "column_type":12, "value":1 }

      ,

      { "id":3, "name":"price", "column_type":12, "value":56 }

      ]
      }

       

       

      So the above has 0 and 1 in place of apple and pears respectively.

       

      Could you of you help me on this, if there are folks who have faced similar kinda issue

       

       

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            utra zeyk
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment