Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
trunk-win, 2.7.1
-
None
-
windows
-
Reviewed
Description
If winutils.exe can't be found HADOOP_HOME wrong/unset or other causes, then an error is logged -but when any of the Shell operations are used, an NPE is raised rather than something meaningful.
The error message at setup time should be preserved and then raised before any attempt to invoke a winutils-driven process made
Attachments
Attachments
Issue Links
- breaks
-
HADOOP-12478 Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath()
- Resolved
- is duplicated by
-
SPARK-2356 Exception: Could not locate executable null\bin\winutils.exe in the Hadoop
- Resolved
-
HADOOP-11003 org.apache.hadoop.util.Shell should not take a dependency on binaries being deployed when used as a library
- Resolved
-
HADOOP-14586 StringIndexOutOfBoundsException breaks org.apache.hadoop.util.Shell on 2.7.x with Java 9
- Resolved
- is related to
-
SPARK-6961 Cannot save data to parquet files when executing from Windows from a Maven Project
- Resolved
- relates to
-
SLIDER-201 jenkins to add windows builds
- Resolved
-
SPARK-2356 Exception: Could not locate executable null\bin\winutils.exe in the Hadoop
- Resolved
-
HADOOP-11003 org.apache.hadoop.util.Shell should not take a dependency on binaries being deployed when used as a library
- Resolved
-
CALCITE-3307 PigRelExTest, PigRelOpTest and PigScriptTest fail on Windows
- Closed