[IMPALA-11124] testdata loading should reuse TPCH/TPCDS local data if they exist

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.1.0
• Component/s: Infrastructure
• Epic Color: ghx-label-11
• Assignee: Quanlong Huang
• Reporter: Quanlong Huang
• Created: 15/Feb/22 08:20
• Updated: 01/Apr/22 03:19
• Resolved: 01/Apr/22 03:19

Description

When loading testdata for TPC-H/TPC-DS, we first run a preload script to generate local data, and then upload them to HDFS to be used by Hive. It's time-consuming to run the preload script in large scale factors (e.g. 30). We should reuse them if they exist.