Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-3485

Avro NULL_DEFAULT_VALUE compatibility issue

Add voteWatch issue
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.4.7
    • None
    • None
    • None

    Description

      Import to Avro fails when using Avro 1.9.2:

      ERROR sqoop.Sqoop: Got exception running Sqoop: org.apache.avro.AvroRuntimeException: Unknown datum class: class com.fasterxml.jackson.databind.node.NullNode
      org.apache.avro.AvroRuntimeException: Unknown datum class: class com.fasterxml.jackson.databind.node.NullNode
      	at org.apache.avro.util.internal.JacksonUtils.toJson(JacksonUtils.java:87)
      	at org.apache.avro.util.internal.JacksonUtils.toJsonNode(JacksonUtils.java:48)
      	at org.apache.avro.Schema$Field.<init>(Schema.java:558)
      	at org.apache.sqoop.orm.AvroSchemaGenerator.generate(AvroSchemaGenerator.java:101)
      	at org.apache.sqoop.mapreduce.DataDrivenImportJob.generateAvroSchema(DataDrivenImportJob.java:131)
      	at org.apache.sqoop.mapreduce.DataDrivenImportJob.configureMapper(DataDrivenImportJob.java:101)
      	at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:266)
      	at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:691)
      	at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:124)
      	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:534)
      	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:633)
      	at org.apache.sqoop.Sqoop.run(Sqoop.java:146)
      	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
      	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:182)
      	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:233)
      	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:242)
      	at org.apache.sqoop.Sqoop.main(Sqoop.java:251)
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            medb Igor Dvorzhak

            Dates

              Created:
              Updated:

              Slack

                Issue deployment