Details
-
Bug
-
Status: Patch Available
-
Major
-
Resolution: Unresolved
-
1.4.0
-
None
-
None
Description
PutParquet doesn't support S3 targets due to the lack of the hadoop-aws dependency.
To recreate it:
1) Modify core-site.xml to change fs.defaultName to one starting with s3://
2) Add a PutParquet
3) It will fail to run. The logs will show the missing hadoop-aws dependency.
Simple fix is just to add hadoop-aws.
Attachments
Issue Links
- links to