Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-8185

IllegalArgumentException thrown by PutKudu processor when using drift feature with record path feature

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.13.0
    • None
    • None
    • None

    Description

      When using the record path feature added in NIFI-7952 and the schema drift feature added in NIFI-7142 together I get the following failures in the PutKudu processor. Disabling the schema drift handling prevents the error.

      PutKudu[id=1cba13e5-0177-1000-0000-00001f1f4a8b] Failed to push StandardFlowFileRecord[uuid=998ebeb6-42ba-4b4d-a18f-892a9446a803,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1611183303349-1, container=default, section=1], offset=0, length=2453],offset=0,name=998ebeb6-42ba-4b4d-a18f-892a9446a803,size=2453] to Kudu: java.lang.IllegalArgumentException: unsupported type RECORD
      java.lang.IllegalArgumentException: unsupported type RECORD
      	at org.apache.nifi.processors.kudu.AbstractKuduProcessor.toKuduType(AbstractKuduProcessor.java:398)
      	at org.apache.nifi.processors.kudu.AbstractKuduProcessor.getAddNullableColumnStatement(AbstractKuduProcessor.java:423)
      	at org.apache.nifi.processors.kudu.PutKudu.trigger(PutKudu.java:403)
      	at org.apache.nifi.processors.kudu.PutKudu.lambda$null$1(PutKudu.java:348)
      	at org.apache.nifi.processors.kudu.AbstractKuduProcessor.executeOnKuduClient(AbstractKuduProcessor.java:194)
      	at org.apache.nifi.processors.kudu.PutKudu.lambda$onTrigger$2(PutKudu.java:348)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:422)
      	at org.apache.nifi.security.krb.AbstractKerberosUser.doAs(AbstractKerberosUser.java:148)
      	at org.apache.nifi.security.krb.KerberosAction.execute(KerberosAction.java:68)
      	at org.apache.nifi.processors.kudu.PutKudu.onTrigger(PutKudu.java:353)
      	at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
      	at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1173)
      	at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:214)
      	at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
      	at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      	at java.lang.Thread.run(Thread.java:748)
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              granthenke Grant Henke
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: