Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
None
-
None
-
None
-
Windows
-
windows, winutils
Description
HIVE-7845 shows how an exception is being thrown when org.apache.hadoop.util.Shell is being used as a library, not as part of a deployed Hadoop environment.
13:20:00 [ERROR pool-2-thread-4 Shell.getWinUtilsPath] Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:324)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:339)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:332)
at org.apache.hadoop.hive.conf.HiveConf$ConfVars.findHadoopBinary(HiveConf.java:918)
at org.apache.hadoop.hive.conf.HiveConf$ConfVars.<clinit>(HiveConf.java:228)
There are similar native dependencies (eg. NativeIO and hadoop.dll) that handle lack of binaries with fallback to non-native code paths.
Attachments
Issue Links
- duplicates
-
HADOOP-10775 Shell operations to fail with meaningful errors on windows if winutils.exe not found
- Resolved
- is related to
-
HADOOP-10051 winutil.exe is not included in hadoop bin tarball
- Open
-
HADOOP-10775 Shell operations to fail with meaningful errors on windows if winutils.exe not found
- Resolved
- relates to
-
SPARK-2356 Exception: Could not locate executable null\bin\winutils.exe in the Hadoop
- Resolved
-
HIVE-7845 "Failed to locate the winutils binary" when loading JDBC driver on Windows
- Patch Available