[HUDI-5065] HoodieCleaner does not exit after completion

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.2
• Component/s: cleaning
• Labels: pull-request-available
• Story Points: 1
• Assignee: Jonathan Vexler
• Reporter: sivabalan narayanan
• Created: 21/Oct/22 05:43
• Updated: 16/Feb/23 05:43
• Resolved: 03/Nov/22 15:46

Description

use org.apache.hudi.utilities.hoodieCleaner realize asynchronous cleaning, after the completion of the spark-submit don't quit, need CTRL + c to exit

 
/opt/spark-3.2.2-bin-3.0.0-cdh6.2.1/bin/spark-submit \ --class org.apache.hudi.utilities.HoodieCleaner \ --jars /opt/hudi-utilities-bundle_2.12-0.12.1.jar \ /opt/hudi-utilities-bundle_2.12-0.12.1.jar \ --target-base-path /db/dwm_http_scan \ --spark-master yarn \ --hoodie-conf hoodie.cleaner.policy=KEEP_LATEST_BY_HOURS \ --hoodie-conf hoodie.cleaner.hours.retained=1
 
 

Issue Links

• links to: GitHub Pull Request #7101
• links to: issue-7010