Mahout
  1. Mahout
  2. MAHOUT-839

rowid job failing (when parsing options)

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Trivial Trivial
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.6
    • Component/s: None
    • Labels:

      Description

      Although MAHOUT-757 moved towards standard option naming, it uses different APIs for option parsing than other jobs.

      On my system, it died reliably with null pointer error. Reported in mail here, but not reconfirmed by anyone else yet: http://permalink.gmane.org/gmane.comp.apache.mahout.user/9659

      Example:

      TellyClub:bin danbri$ ./mahout rowid --help

      MAHOUT_LOCAL is set, so we don't add HADOOP_CONF_DIR to classpath.
      MAHOUT_LOCAL is set, running locally

      [skipping some hopefully unrelated SLF4J errors re same thing on classpath twice]

      Exception in thread "main" java.lang.NullPointerException
      at org.apache.hadoop.fs.Path.<init>(Path.java:61)
      at org.apache.hadoop.fs.Path.<init>(Path.java:50)
      at org.apache.mahout.utils.vectors.RowIdJob.run(RowIdJob.java:49)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
      at org.apache.mahout.utils.vectors.RowIdJob.main(RowIdJob.java:89)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
      at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
      at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:188)

      1. MAHOUT-839-v2.patch
        7 kB
        Dan Brickley
      2. MAHOUT-839.patch
        7 kB
        Dan Brickley

        Activity

        Sean Owen made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Sean Owen made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Fix Version/s 0.6 [ 12316364 ]
        Resolution Fixed [ 1 ]
        Grant Ingersoll made changes -
        Priority Major [ 3 ] Trivial [ 5 ]
        Grant Ingersoll made changes -
        Assignee Grant Ingersoll [ gsingers ]
        Dan Brickley made changes -
        Attachment MAHOUT-839-v2.patch [ 12498609 ]
        Dan Brickley made changes -
        Description Although MAHOUT-757 moved towards standard option naming, it uses different APIs for option parsing than other jobs.

        On my system, it died reliably with null pointer error. Reported in mail here, but not reconfirmed by anyone else yet: http://permalink.gmane.org/gmane.comp.apache.mahout.user/9659

        Example:

        TellyClub:bin danbri$ ./mahout rowid --help
        MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath.
        Running on hadoop, using HADOOP_HOME=/Users/danbri/working/hadoop/hadoop-0.20.2
        HADOOP_CONF_DIR=/Users/danbri/working/hadoop/hadoop-0.20.2/conf
        MAHOUT-JOB: /Users/danbri/working/mahout/trunk/examples/target/mahout-examples-0.6-SNAPSHOT-job.jar
        ^CTellyClub:bin danbri$ MAHOUT_LOCAL=true ./mahout rowid --help
        MAHOUT_LOCAL is set, so we don't add HADOOP_CONF_DIR to classpath.
        MAHOUT_LOCAL is set, running locally
        SLF4J: Class path contains multiple SLF4J bindings.
        SLF4J: Found binding in
        [jar:file:/Users/bandri/working/mahout/trunk/examples/target/mahout-examples-0.6-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
        SLF4J: Found binding in
        [jar:file:/Users/bandri/working/mahout/trunk/examples/target/dependency/slf4j-jcl-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
        SLF4J: Found binding in
        [jar:file:/Users/bandri/working/mahout/trunk/examples/target/dependency/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
        SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
        Exception in thread "main" java.lang.NullPointerException
        at org.apache.hadoop.fs.Path.<init>(Path.java:61)
        at org.apache.hadoop.fs.Path.<init>(Path.java:50)
        at org.apache.mahout.utils.vectors.RowIdJob.run(RowIdJob.java:49)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.mahout.utils.vectors.RowIdJob.main(RowIdJob.java:89)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
        at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
        at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:188)
        Although MAHOUT-757 moved towards standard option naming, it uses different APIs for option parsing than other jobs.

        On my system, it died reliably with null pointer error. Reported in mail here, but not reconfirmed by anyone else yet: http://permalink.gmane.org/gmane.comp.apache.mahout.user/9659

        Example:

        TellyClub:bin danbri$ ./mahout rowid --help

        MAHOUT_LOCAL is set, so we don't add HADOOP_CONF_DIR to classpath.
        MAHOUT_LOCAL is set, running locally

        [skipping some hopefully unrelated SLF4J errors re same thing on classpath twice]

        Exception in thread "main" java.lang.NullPointerException
        at org.apache.hadoop.fs.Path.<init>(Path.java:61)
        at org.apache.hadoop.fs.Path.<init>(Path.java:50)
        at org.apache.mahout.utils.vectors.RowIdJob.run(RowIdJob.java:49)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.mahout.utils.vectors.RowIdJob.main(RowIdJob.java:89)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
        at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
        at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:188)
        Labels options rowid
        Dan Brickley made changes -
        Field Original Value New Value
        Attachment MAHOUT-839.patch [ 12498607 ]
        Dan Brickley created issue -

          People

          • Assignee:
            Grant Ingersoll
            Reporter:
            Dan Brickley
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development