[IMPALA-5665] test_create_cache_many_tables fails with ConcurrentModificationException

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: Impala 2.10.0
• Component/s: Catalog
• Labels: broken-build
• Epic Color: ghx-label-8
• Assignee: Dimitris Tsirogiannis
• Reporter: Thomas Tauber-Marshall
• Created: 14/Jul/17 18:36
• Updated: 14/Jul/17 18:44
• Resolved: 14/Jul/17 18:44

Description

Seen in an exhaustive Jenkins build:

18:52:01  TestDdlStress.test_create_cache_many_tables[exec_option: {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 0, 'disable_codegen': True, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format: text/none-8] 
18:52:01 [gw2] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/bin/../infra/python/env/bin/python
18:52:01 stress/test_ddl_stress.py:91: in test_create_cache_many_tables
18:52:01     self.client.execute("drop table %s_part" % tbl_name)
18:52:01 common/impala_connection.py:160: in execute
18:52:01     return self.__beeswax_client.execute(sql_stmt, user=user)
18:52:01 beeswax/impala_beeswax.py:173: in execute
18:52:01     handle = self.__execute_query(query_string.strip(), user=user)
18:52:01 beeswax/impala_beeswax.py:337: in __execute_query
18:52:01     handle = self.execute_query_async(query_string, user=user)
18:52:01 beeswax/impala_beeswax.py:333: in execute_query_async
18:52:01     return self.__do_rpc(lambda: self.imp_service.query(query,))
18:52:01 beeswax/impala_beeswax.py:458: in __do_rpc
18:52:01     raise ImpalaBeeswaxException(self.__build_error_message(b), b)
18:52:01 E   ImpalaBeeswaxException: ImpalaBeeswaxException:
18:52:01 E    INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
18:52:01 E    MESSAGE: ConcurrentModificationException: null

From catalogd.INFO:

I0713 07:26:15.792037  8115 jni-util.cc:187] java.util.ConcurrentModificationException
        at java.util.HashMap$HashIterator.nextEntry(HashMap.java:922)
        at java.util.HashMap$ValueIterator.next(HashMap.java:950)
        at org.apache.impala.service.CatalogOpExecutor.uncacheTable(CatalogOpExecutor.java:1407)
        at org.apache.impala.service.CatalogOpExecutor.dropTableOrView(CatalogOpExecutor.java:1381)
        at org.apache.impala.service.CatalogOpExecutor.execDdlRequest(CatalogOpExecutor.java:299)
        at org.apache.impala.service.JniCatalog.execDdl(JniCatalog.java:142)

Issue Links

• duplicates: IMPALA-5288 TestDdlStress.test_create_cache_many_tables failed with ConcurrentModificationException