[IMPALA-9535] Test for conversion from non-ACID to ACID fail on newer Hive

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 4.0.0
• Fix Version/s: Impala 4.0.0
• Component/s: Frontend
• Labels: broken-build
• Target Version: Impala 4.0.0
• Epic Color: ghx-label-7
• Assignee: Unassigned
• Reporter: Joe McDonnell
• Created: 19/Mar/20 16:40
• Updated: 31/Aug/20 20:55
• Resolved: 31/Aug/20 20:55

Description

When using a newer CDP GBN, Hive is enforcing a strict separation between the hive.metastore.warehouse.external.dir vs hive.metastore.warehouse.dir. This causes failures in tests that convert a table from non-ACID to ACID on the USE_CDP_HIVE=true configuration:

query_test/test_acid.py:52: in test_acid_basic
    self.run_test_case('QueryTest/acid', vector, use_db=unique_database)
common/impala_test_suite.py:659: in run_test_case
    result = exec_fn(query, user=test_section.get('USER', '').strip() or None)
common/impala_test_suite.py:610: in __exec_in_hive
    result = h.execute(query, user=user)
common/impala_connection.py:334: in execute
    r = self.__fetch_results(handle, profile_format=profile_format)
common/impala_connection.py:441: in __fetch_results
    cursor._wait_to_finish()
/data/jenkins/workspace/impala-private-basic-parameterized/repos/Impala/infra/python/env/lib/python2.7/site-packages/impala/hiveserver2.py:412: in _wait_to_finish
    raise OperationalError(resp.errorMessage)
E   OperationalError: Error while compiling statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.ddl.DDLTask. Unable to alter table. A managed table's location needs to be under the hive warehouse root directory,table:upgraded_table,location:/test-warehouse/test_acid_basic_34c57c48.db/upgraded_table,Hive warehouse:/test-warehouse/managed

This impacts the following tests:

query_test.test_acid.TestAcid.test_acid_basic
query_test.test_acid.TestAcid.test_acid_compaction
query_test.test_acid.TestAcid.test_acid_partitioned