Uploaded image for project: 'Giraph'
  1. Giraph
  2. GIRAPH-1030

Stop using mapred.job.id (is deprecated). Instead, start using mapreduce.job.id

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Trivial
    • Resolution: Unresolved
    • Affects Version/s: 1.1.0
    • Fix Version/s: None
    • Component/s: conf and scripts
    • Labels:
    • Environment:

      Ubuntu 14.04 LTS, Hadoop 2.4.0

      Description

      When i'm starting a new Giraph Job, there is always a warning about a deprecated property, and that property is being programmatically set by GiraphYarnClient class(GiraphYarnClient.java, line 196, http://grepcode.com/file/repo1.maven.org/maven2/org.apache.giraph/giraph-core/1.1.0/org/apache/giraph/yarn/GiraphYarnClient.java#196).

      It is not being taken from a XML config file and it's very confusing for newbies, because it can't be easily fixed.

      It will be nice if the non-deprecated property (mapreduce.job.id) can be used instead

      A brief (and very generic) log with the problem:
      15/08/29 12:42:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
      15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your InputFormat does not require one.
      15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge output format specified. Ensure your OutputFormat does not require one.
      15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Final output path is: hdfs://hdnode01:54310/user/hduser/output/caminosNavegacionales1
      15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Running Client
      15/08/29 12:42:18 INFO client.RMProxy: Connecting to ResourceManager at hdnode01/192.168.0.10:8050
      15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM for, nodeId=hadoop100:51831, nodeAddress hadoop100:8042, nodeRackName /default-rack, nodeNumContainers 0
      15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM for, nodeId=hadoop101:40809, nodeAddress hadoop101:8042, nodeRackName /default-rack, nodeNumContainers 0
      15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Obtained new Application ID: application_1440862856801_0001
      15/08/29 12:42:18 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id
      15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Set the environment for the application master
      ...

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jlarroque Jose Luis Larroque
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: