[HIVE-21816] HMS Translation: Refactor tests to work with ACID tables.

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Hive
• Target Version/s: 4.0.0
• Assignee: Naveen Gangam
• Reporter: Naveen Gangam
• Created: 31/May/19 17:04
• Updated: 17/Nov/22 08:51
• Resolved: 07/Jun/19 19:09

Description

1) TestHiveMetaStore unit tests does not work for full ACID tables as the TransactionalValidationListener enforces that this table use AcidIO. The Orc IO files are only included in the hive-exec jars that are not used by tests under standalone-metastore module. Even adding a test-scoped dependency on hive-exec did not work. I had to relocate these tests into itests.

2) Implementation of logic that allows skipping of translation via the use of "MANAGERAWMETADATA" capability.

3) Fixed some test bugs as the test was not failing originally when the createTable failed because of the issue in #1. As a result, about 3 tests never ran fully and never failed. The tests now fail if there are issues.

4) Refactoring of the code in the DefaultTransformer to make static lists of capabilities. The return capabilities now is dependent on the table capabilities, the processor capabilities and the accessType assigned to the table.

Issue Links

• causes: HIVE-21852 Testcases are randomly failing with ArrayIndexOutOfBoundException