[IMPALA-9420] test_scanners.TestOrc.test_type conversions fails after first run

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.0.0
• Component/s: Infrastructure
• Labels: orc ramp-up
• Epic Color: ghx-label-10
• Assignee: Unassigned
• Reporter: Norbert Luksa
• Created: 25/Feb/20 09:09
• Updated: 23/Dec/20 19:59
• Resolved: 23/Dec/20 19:59

Description

The mentioned test passes on the first run, but fails later on, finding more rows than expected.
By running

hdfs dfs -ls -R / | grep union_comlextypes

we can find that the previously created files are not cleaned up, so Impala will find and scan them.

The problem could be that the union_complextypes and ill_complextypes tables are created as externals.

Issue Links

• is fixed by: IMPALA-9702 TestDdlStatements::test_alter_table() and TestMixedPartitions::test_incompatible_avro_partition_in_non_avro_table() consistently fail on S3