Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5975

[WebHCat] templeton mapreduce job failed if provide "define" parameters

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.12.0, 0.13.0
    • 0.13.0
    • HCatalog
    • None

    Description

      Trying to submit a mapreduce job through templeton failed:

      curl -k -u user:pass -d user.name=user -d define=JobName=MRPiJob -d class=pi -d arg=16 -d arg=100 -d jar="hadoop-mapreduce-examples.jar" https://xxx/templeton/v1/mapreduce/jar

      The error message is:
      "Usage: org.apache.hadoop.examples.QuasiMonteCarlo <nMaps> <nSamples>
      Generic options supported are
      -conf <configuration file> specify an application configuration file
      -D <property=value> use value for given property
      -fs <local|namenode:port> specify a namenode
      -jt <local|jobtracker:port> specify a job tracker
      -files <comma separated list of files> specify comma separated files to be copied to the map reduce cluster
      -libjars <comma separated list of jars> specify comma separated jar files to include in the classpath.
      -archives <comma separated list of archives> specify comma separated archives to be unarchived on the compute machines.

      The general command line syntax is
      bin/hadoop command [genericOptions] [commandOptions]

      templeton: job failed with exit code 2"

      Note that if we remove the "define" parameter it works fine.

      Attachments

        1. hive-5975.2.patch
          2 kB
          shanyu zhao
        2. hive-5975.patch
          1 kB
          shanyu zhao

        Activity

          People

            shanyu shanyu zhao
            shanyu shanyu zhao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: