Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9535

Test for conversion from non-ACID to ACID fail on newer Hive

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 4.0.0
    • Impala 4.0.0
    • Frontend

    Description

      When using a newer CDP GBN, Hive is enforcing a strict separation between the hive.metastore.warehouse.external.dir vs hive.metastore.warehouse.dir. This causes failures in tests that convert a table from non-ACID to ACID on the USE_CDP_HIVE=true configuration:

      query_test/test_acid.py:52: in test_acid_basic
          self.run_test_case('QueryTest/acid', vector, use_db=unique_database)
      common/impala_test_suite.py:659: in run_test_case
          result = exec_fn(query, user=test_section.get('USER', '').strip() or None)
      common/impala_test_suite.py:610: in __exec_in_hive
          result = h.execute(query, user=user)
      common/impala_connection.py:334: in execute
          r = self.__fetch_results(handle, profile_format=profile_format)
      common/impala_connection.py:441: in __fetch_results
          cursor._wait_to_finish()
      /data/jenkins/workspace/impala-private-basic-parameterized/repos/Impala/infra/python/env/lib/python2.7/site-packages/impala/hiveserver2.py:412: in _wait_to_finish
          raise OperationalError(resp.errorMessage)
      E   OperationalError: Error while compiling statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.ddl.DDLTask. Unable to alter table. A managed table's location needs to be under the hive warehouse root directory,table:upgraded_table,location:/test-warehouse/test_acid_basic_34c57c48.db/upgraded_table,Hive warehouse:/test-warehouse/managed

      This impacts the following tests:

      query_test.test_acid.TestAcid.test_acid_basic
      query_test.test_acid.TestAcid.test_acid_compaction
      query_test.test_acid.TestAcid.test_acid_partitioned

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            joemcdonnell Joe McDonnell
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment