Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-2271

HCatalog ORC Null Pointer Exception

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Blocker
    • Resolution: Unresolved
    • Affects Version/s: 1.4.5
    • Fix Version/s: None
    • Component/s: codegen, hive-integration
    • Labels:
      None
    • Environment:

      HDP 2.2

      Description

      Hitting a Null Pointer Exception when importing a table via HCatalog to ORC. We do a lot of SQL Server imports, the only additions are the hcatalog / orc options:

      sqoop import --connect "jdbc:sqlserver://host:1533;database=myDB" --username "myUser" --password "myPassword" --verbose -m 1 --query "select * from [blah].[dbo].[blah2]" --mapreduce-job-name "sqoop-import-myJob" --create-hcatalog-table --hcatalog-table "mydb.mytable" --hcatalog-storage-stanza "STORED AS ORC"
      
      15/03/27 12:32:12 INFO hcat.SqoopHCatUtilities: Executing external HCatalog CLI process with args :-f,/tmp/hcat-script-1427459532585
      15/03/27 12:32:12 DEBUG util.ClassLoaderStack: Restoring classloader: java.net.URLClassLoader@7640f42a
      15/03/27 12:32:12 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.NullPointerException
      java.lang.NullPointerException
              at java.lang.ProcessBuilder.start(ProcessBuilder.java:1010)
              at java.lang.Runtime.exec(Runtime.java:617)
              at java.lang.Runtime.exec(Runtime.java:528)
              at org.apache.sqoop.util.Executor.exec(Executor.java:76)
              at org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities.executeExternalHCatProgram(SqoopHCatUtilities.java:1119)
              at org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities.launchHCatCli(SqoopHCatUtilities.java:1071)
              at org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities.createHCatTable(SqoopHCatUtilities.java:610)
              at org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities.configureHCat(SqoopHCatUtilities.java:325)
              at org.apache.sqoop.mapreduce.hcat.SqoopHCatUtilities.configureImportOutputFormat(SqoopHCatUtilities.java:768)
              at org.apache.sqoop.mapreduce.ImportJobBase.configureOutputFormat(ImportJobBase.java:98)
              at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:249)
              at org.apache.sqoop.manager.SqlManager.importQuery(SqlManager.java:721)
              at org.apache.sqoop.manager.SQLServerManager.importQuery(SQLServerManager.java:346)
              at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:499)
              at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:601)
              at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
              at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
              at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
              at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
              at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
      

      At first I thought this was SQOOP-1533 but the stack trace is different and we're on Oracle Java 7.

      Hari Sekhon
      http://www.linkedin.com/in/harisekhon

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              harisekhon Hari Sekhon
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: