-
Type:
Sub-task
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: None
-
Fix Version/s: 2.3.0
-
Component/s: None
-
Labels:None
Currently, when doing INSERT statements on tables located at S3, Hive writes and reads temporary (or intermediate) files to S3 as well.
If HDFS is still the default filesystem on Hive, then we can keep such temporary files on HDFS to keep things run faster.
- relates to
-
SPARK-21514 Hive has updated with new support for S3 and InsertIntoHiveTable.scala should update also
-
- In Progress
-
- links to