Uploaded image for project: 'Spot (Retired)'
  1. Spot (Retired)
  2. SPOT-29

[ML] Error in running ML ./ml_ops.sh

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • ubuntu 14.04

    Description

      I am getting error when executing the Machine learning part.

      ./ml_ops.sh 20150401 flow 1e-10 200

      error is -

      cloudera@worker:~/oni-ml$ ./ml_ops.sh 20161216 flow 1e-10 200
      17/01/10 11:34:33 INFO Remoting: Starting remoting
      17/01/10 11:34:33 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriverActorSystem@172.27.3.213:59340]
      17/01/10 11:34:33 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkDriverActorSystem@172.27.3.213:59340]
      spark.yarn.driver.memoryOverhead is set but does not apply in client mode.
      spark.driver.cores is set but does not apply in client mode.
      cloudera@worker's password:
      cloudera@worker's password:
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)
      [proxy:0:0@worker] HYDU_create_process (utils/launch/launch.c:75): execvp error on file ./lda (No such file or directory)

      ===================================================================================
      = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
      = PID 27332 RUNNING AT worker
      = EXIT CODE: 255
      = CLEANING UP REMAINING PROCESSES
      = YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
      ===================================================================================
      Exception in thread "main" java.lang.RuntimeException: Nonzero exit value: 255
      at scala.sys.package$.error(package.scala:27)
      at scala.sys.process.ProcessBuilderImpl$AbstractBuilder.slurp(ProcessBuilderImpl.scala:131)
      at scala.sys.process.ProcessBuilderImpl$AbstractBuilder.$bang$bang(ProcessBuilderImpl.scala:101)
      at org.opennetworkinsight.OniLDACWrapper$.runLDA(OniLDACWrapper.scala:84)
      at org.opennetworkinsight.netflow.FlowSuspiciousConnects$.run(FlowSuspiciousConnects.scala:19)
      at org.opennetworkinsight.SuspiciousConnects$.main(SuspiciousConnects.scala:46)
      at org.opennetworkinsight.SuspiciousConnects.main(SuspiciousConnects.scala)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:498)
      at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
      at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
      at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
      at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
      at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

      real 0m54.418s
      user 0m27.392s
      sys 0m1.104s

      I am stuck at above error.

      Attachments

        Activity

          People

            rabarona Ricardo Barona
            rajeshpatil rajesh patil
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: