[HAWQ-1120] Optimize hawqregister performance

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Done
• Fix Version/s: 2.1.0.0-incubating
• Component/s: Command Line Tools
• Assignee: Hong Wu
• Reporter: Hong Wu
• Created: 25/Oct/16 13:52
• Updated: 18/Feb/17 05:27
• Resolved: 22/Dec/16 06:42

Description

move_files_in_hdfs, check_sizes_valid and check_file_not_folder take 30% execute time of hawqregister since invoking hadoop shell command has 1-2s lantency each time.

In check_sizes_valid, we could bind "du" operation together to optimize. For the other two functions, there is nothing to do.

Issue Links

• links to: GitHub Pull Request #973