Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-2566

Sqoop incremental import using --query switch throws NullPointerException with a managed table

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • 1.4.5
    • 1.5.0
    • None
    • None
    • Patch, Important

    Description

      NullpointerException is thrown when incremental import is done with a managed table using --query switch

      sqoop import -Dmapred.job.queue.name=default --connection-manager com.cloudera.sqoop.manager.TeradataManager --connect <connectionString> --username lbansal --P --split-by ID --hcatalog-storage-stanza='stored as sequencefile' --query 'select * from test where $CONDITIONS' --create-hcatalog-table --hcatalog-database platdev --hcatalog-table test --compress --compression-codec snappy --incremental lastmodified --check-column DAT --last-value '2014-10-17 07:00:00'

      Stacktrace
      --------------

      15/07/07 05:36:51 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.NullPointerException
      java.lang.NullPointerException
      at org.apache.hadoop.fs.FileSystem.fixRelativePart(FileSystem.java:2170)
      at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1131)
      at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1423)
      at org.apache.sqoop.tool.ImportTool.initIncrementalConstraints(ImportTool.java:333)
      at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:501)
      at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:641)
      at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
      at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
      at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
      at org.apache.sqoop.Sqoop.main(Sqoop.java:236)

      Attachments

        1. SQOOP-2566_0.patch
          0.7 kB
          Shashank

        Issue Links

          Activity

            People

              standon Shashank
              ajaysingh5026 Ajay Singh
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - 72h
                  72h
                  Remaining:
                  Remaining Estimate - 72h
                  72h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified