Details
-
Improvement
-
Status: Closed
-
Critical
-
Resolution: Fixed
-
0.9.0
-
hudi 0.9.0
spark3.1.1
hive3.1.1
hadoop3.1.1
Description
If multiple partitions exist and the final result of RDD.isEmpty is true, Spark starts multiple jobs in 5-fold increment mode. As a result, the computing performance deteriorates.