Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
2.8.0
-
None
-
None
Description
Running some spark s3a tests trigger an NPE in Hadoop <=2/7l IOE in 2.8 saying
${hadoop.tmp.dir}/s3a not configured.
That's correct: there is no configuration option on the conf called
${hadoop.tmp.dir}/s3a
There may be one called hadoop.tmp.dir, however.
Essentially s3a is sending the wrong config option down, if it can't find fs.s3a.buffer.dir
Attachments
Issue Links
- is depended upon by
-
HADOOP-11694 Über-jira: S3a phase II: robustness, scale and performance
-
- Resolved
-
- is part of
-
HADOOP-13560 S3ABlockOutputStream to support huge (many GB) file writes
-
- Resolved
-