[IMPALA-7726] Drop with purge tests fail against ABFS due to trash misbehavior

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 3.4.0
• Labels: flaky
• Epic Color: ghx-label-7
• Assignee: Sean Mackrory
• Reporter: Sean Mackrory
• Created: 18/Oct/18 22:19
• Updated: 06/Nov/19 16:54
• Resolved: 06/Nov/19 16:54

Description

In testing IMPALA-7681, I've seen test_drop_partition_with_purge and test_drop_table_with_purge fail because of files not found in the trash are a drop without purge. I've traced that functionality through Hive, which uses Hadoop's Trash API, and traced through a bunch of scenarios in that API with ABFS and I can't see it misbehaving in any way. It also should be pretty FS-agnostic. I also suspected a bug in abfs_utils.py's exists() function, but have not been able to find one.

Issue Links

• is related to: IMPALA-7681 Support new URI scheme for ADLS Gen2