Uploaded image for project: 'Giraph (Retired)'
  1. Giraph (Retired)
  2. GIRAPH-1030

Stop using mapred.job.id (is deprecated). Instead, start using mapreduce.job.id

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Trivial
    • Resolution: Unresolved
    • 1.1.0
    • None
    • conf and scripts
    • Ubuntu 14.04 LTS, Hadoop 2.4.0

    Description

      When i'm starting a new Giraph Job, there is always a warning about a deprecated property, and that property is being programmatically set by GiraphYarnClient class(GiraphYarnClient.java, line 196, http://grepcode.com/file/repo1.maven.org/maven2/org.apache.giraph/giraph-core/1.1.0/org/apache/giraph/yarn/GiraphYarnClient.java#196).

      It is not being taken from a XML config file and it's very confusing for newbies, because it can't be easily fixed.

      It will be nice if the non-deprecated property (mapreduce.job.id) can be used instead

      A brief (and very generic) log with the problem:
      15/08/29 12:42:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
      15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your InputFormat does not require one.
      15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge output format specified. Ensure your OutputFormat does not require one.
      15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Final output path is: hdfs://hdnode01:54310/user/hduser/output/caminosNavegacionales1
      15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Running Client
      15/08/29 12:42:18 INFO client.RMProxy: Connecting to ResourceManager at hdnode01/192.168.0.10:8050
      15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM for, nodeId=hadoop100:51831, nodeAddress hadoop100:8042, nodeRackName /default-rack, nodeNumContainers 0
      15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM for, nodeId=hadoop101:40809, nodeAddress hadoop101:8042, nodeRackName /default-rack, nodeNumContainers 0
      15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Obtained new Application ID: application_1440862856801_0001
      15/08/29 12:42:18 INFO Configuration.deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id
      15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Set the environment for the application master
      ...

      Attachments

        Activity

          People

            Unassigned Unassigned
            jlarroque Jose Luis Larroque
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: