Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8536

Problem with -Dproperty=value option on windows hadoop

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      While running the java examples the -Dproperty=value option to the hadoop command is not getting read correctly.

      TERASORT COMMAND:
      C:\hdp\branch-1-win\bin\hadoop jar C:\hdp\branch-1-win\build\hadoop-examples-1.1.0-SNAPSHOT.jar terasort -Dmapreduce.reduce.input.limit=-1 teraInputDir teraOutputDir
      Error-
      12/06/27 10:28:26 INFO terasort.TeraSort: starting
      org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: hdfs://localhost:8020/user/Administrator/-1

      It tries to look into directory named -1 instead of teraInputDir
      On setting "echo on" in the cmd scripts, I noticed that the "=" sign disappears in the command passed to JVM-
      terasort -Dmapreduce.reduce.input.limit -1 teraInputDir teraOutputDir

      In order to make it read properly quotes around “-Dproperty=value” are required to be used.

      This JIRA is to track fixing this issue.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                tdhavle Trupti Dhavle
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: