[IMPALA-4005] generate_statements method in generate_schema_statements.py needs refactoring

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Impala 2.7.0
• Component/s: Infrastructure
• Labels: ramp-up test-infra
• Target Version: Product Backlog
• Assignee: David Knupp
• Reporter: Harrison Sheinblatt
• Created: 20/Aug/16 22:27
• Updated: 23/Oct/18 22:40

Description

testdata/bin/generate-schema-statements.py

The generate_statements method is too long to efficiently debug.

Issue Links

• is related to: IMPALA-4482 Loading Impala's test data produces different TPCDS data on local vs. remote clusters for partitioned tables
• is related to: IMPALA-4520 Use RECOVER PARTITIONS in our data load process where possible
• is related to: IMPALA-4534 Not all of the data load files follow the accepted format when partitioning test data tables