Details
-
Improvement
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
Currently there is one parameter that is used for setting the staging directory: hive.exec.stagingdir, which will be used both on HDFS and on S3 when set. A current workaround is to manually set the staging directory before inserting into a S3 table.
The requested feature is to introduce a new paramater that would only set teh location of the staging directory on S3, thus separating it from the HDFS staging directory setting