[HIVE-22899] Make sure qtests clean up copied files from test directories

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Assignee: Zoltan Chovan
• Reporter: Zoltan Chovan
• Created: 18/Feb/20 10:51
• Updated: 21/Jan/23 10:07
• Resolved: 04/Mar/20 16:42

Description

Several qtest files are copying schema or test files to the test directories (such as ${system:test.tmp.dir} and ${hiveconf:hive.metastore.warehouse.dir}), many times without changing the name of the copied file. When the same files is copied by another qtest to the same directory the copy and hence the test fails. This can lead to flaky tests when any two of these qtests gets scheduled to the same batch.

 

In order to avoid these failures, we should make sure the files copied to the test dirs have unique names and we should make sure these files are cleaned up by the same qtest files that copies the file.

Issue Links

• relates to: HIVE-26895 Backport of HIVE-22899: Make sure qtests clean up copied files from test directories