Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11784

failed to locate Winutils for win 32 platform

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 2.6.0
    • None
    • bin
    • None

    Description

      During the execution of Map reduce example first I got the error telling
      ERROR util.Shell: Failed to locate the winutils binary in the hadoop binary path

      So I downloaded a version and update the bin folder again executing the same command I am getting error like

      ERROR util.Shell: Failed to locate the winutils binary in the hadoop binary path
      java.io.IOException: Could not locate executable C:\hadoop-2.6.0\bin\winutils.exe in the Hadoop binaries.
      at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:355)
      at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:370)
      at org.apache.hadoop.util.Shell.<clinit>(Shell.java:363)
      at org.apache.hadoop.util.GenericOptionsParser.preProcessForWindows(GenericOptionsParser.java:438)
      at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:484)
      at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
      at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:64)
      at org.apache.hadoop.examples.Grep.main(Grep.java:101)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:601)
      at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
      at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
      at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:601)
      at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
      at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
      15/04/01 19:12:51 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where ap
      licable
      15/04/01 19:12:52 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
      15/04/01 19:12:52 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
      java.lang.NullPointerException
      at java.lang.ProcessBuilder.start(ProcessBuilder.java:1011)
      at org.apache.hadoop.util.Shell.runCommand(Shell.java:482)
      at org.apache.hadoop.util.Shell.run(Shell.java:455)
      at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
      at org.apache.hadoop.util.Shell.execCommand(Shell.java:808)
      at org.apache.hadoop.util.Shell.execCommand(Shell.java:791)
      at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:656)
      at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:444)
      at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:293)
      at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:133)
      at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:437)
      at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)
      at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:415)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
      at org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)
      at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1314)
      at org.apache.hadoop.examples.Grep.run(Grep.java:77)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      at org.apache.hadoop.examples.Grep.main(Grep.java:101)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:601)
      at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
      at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
      at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:601)
      at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
      at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

      Please let me know if you have patch for the solution.

      Attachments

        Issue Links

          Activity

            People

              kiranmr Kiran Kumar M R
              GATI1978 Gaurav Tiwari
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: