-
Type:
Bug
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: 2.0.0, 2.0.1
-
Component/s: Spark Core, YARN
-
Labels:None
Recently, for the changes to SPARK-14423 Handle jar conflict issue when uploading to distributed cache
If by default yarn#client will upload all the --files and --archives in assembly to HDFS staging folder. It should throw if file appears in both --files and --archives exception to know whether uncompress or leave the file compressed.
- breaks
-
SPARK-18357 YARN --files/--archives broke
-
- Resolved
-
- links to