Sqoop
  1. Sqoop
  2. SQOOP-453

Oozie does not work with Sqoop metastore

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.3.0
    • Fix Version/s: 1.4.2
    • Component/s: None
    • Labels:
      None

      Description

      The sqoop metastore is handy for retaining lastvalue during incremental imports.
      Unfortunately, it does not work with Oozie. Here's the log from the launcher:

      java.lang.NullPointerException
      at com.cloudera.sqoop.SqoopOptions.securePasswordEntry(SqoopOptions.java:1069)
      at com.cloudera.sqoop.SqoopOptions.setPasswordFromConsole(SqoopOptions.java:1077)
      at com.cloudera.sqoop.SqoopOptions.loadProperties(SqoopOptions.java:562)
      at com.cloudera.sqoop.metastore.hsqldb.HsqldbJobStorage.read(HsqldbJobStorage.java:303)
      at com.cloudera.sqoop.tool.JobTool.execJob(JobTool.java:203)
      at com.cloudera.sqoop.tool.JobTool.run(JobTool.java:288)
      at com.cloudera.sqoop.Sqoop.run(Sqoop.java:146)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
      at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:182)
      at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:221)
      at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:230)
      at com.cloudera.sqoop.Sqoop.main(Sqoop.java:239)
      at org.apache.oozie.action.hadoop.SqoopMain.runSqoopJob(SqoopMain.java:198)
      at org.apache.oozie.action.hadoop.SqoopMain.run(SqoopMain.java:172)
      at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:26)
      at org.apache.oozie.action.hadoop.SqoopMain.main(SqoopMain.java:43)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:391)
      at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
      at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:391)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
      at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
      at org.apache.hadoop.mapred.Child.main(Child.java:264)

      1. SQOOP-453.patch
        2 kB
        Cheolsoo Park

        Activity

        Jarek Jarcec Cecho made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 1.4.2-incubating [ 12320141 ]
        Resolution Fixed [ 1 ]
        Cheolsoo Park made changes -
        Attachment SQOOP-453.patch [ 12524060 ]
        Cheolsoo Park made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Cheolsoo Park made changes -
        Field Original Value New Value
        Assignee Cheolsoo Park [ cheolsoo ]
        Patrick Angeles created issue -

          People

          • Assignee:
            Cheolsoo Park
            Reporter:
            Patrick Angeles
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development