Details
-
Task
-
Status: Closed
-
Major
-
Resolution: Done
-
None
-
None
-
None
Description
Currently, HoodieCommitArchiveLog depends on JavaSparkContext in its two methods: archiveIfRequired and getInstantsToArchive. These two methods pass JavaSparkContext to get HoodieTable object. After diving into the call chain, I found we can replace JavaSparkContext with Configuration and other some cleanup(e.g. HUDI-658). After that, we can make HoodieCommitArchiveLog spark free.