Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4528

Crash in catalog

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Cannot Reproduce
    • Impala 2.8.0
    • None
    • Catalog

    Description

      There was a crash in the catalog in the asf-master-s3 build during metadata/test_ddl.py::TestDdlStatements::test_drop_cleans_hdfs_dirs

      CORE: ./tests/core.1479911884.5675.catalogd
      BINARY: ./be/build/latest/catalog/catalogd
      Core was generated by `/data/jenkins/workspace/impala-umbrella-build-and-test-s3/repos/Impala/be/build'.
      Program terminated with signal 6, Aborted.
      #0  0x000000380b4328e5 in raise () from /lib64/libc.so.6
      To enable execution of this file add
      	add-auto-load-safe-path /data/jenkins/workspace/impala-umbrella-build-and-test-s3/Impala-Toolchain/gcc-4.9.2/lib64/libstdc++.so.6.0.20-gdb.py
      line to your configuration file "/var/lib/jenkins/.gdbinit".
      To completely disable this security protection add
      	set auto-load safe-path /
      line to your configuration file "/var/lib/jenkins/.gdbinit".
      For more information about this security protection see the
      "Auto-loading safe path" section in the GDB manual.  E.g., run from the shell:
      	info "(gdb)Auto-loading safe path"
      #0  0x000000380b4328e5 in raise () from /lib64/libc.so.6
      #1  0x000000380b4340c5 in abort () from /lib64/libc.so.6
      #2  0x000000000281a264 in google::DumpStackTraceAndExit() ()
      #3  0x00000000028136cd in google::LogMessage::Fail() ()
      #4  0x0000000002815ff6 in google::LogMessage::SendToLog() ()
      #5  0x00000000028131ed in google::LogMessage::Flush() ()
      #6  0x0000000002816a9e in google::LogMessageFatal::~LogMessageFatal() ()
      #7  0x00000000011b544b in impala::Catalog::Catalog (this=0x9009dc0) at /data/jenkins/workspace/impala-umbrella-build-and-test-s3/repos/Impala/be/src/catalog/catalog.cc:73
      #8  0x0000000001177cb6 in impala::CatalogServer::Start (this=0x7fffbc9eb0a0) at /data/jenkins/workspace/impala-umbrella-build-and-test-s3/repos/Impala/be/src/catalog/catalog-server.cc:169
      #9  0x000000000116b73b in CatalogdMain (argc=6, argv=0x7fffbc9eb6b8) at /data/jenkins/workspace/impala-umbrella-build-and-test-s3/repos/Impala/be/src/catalog/catalogd-main.cc:80
      #10 0x000000000116ad3f in main (argc=6, argv=0x7fffbc9eb6b8) at /data/jenkins/workspace/impala-umbrella-build-and-test-s3/repos/Impala/be/src/service/daemon-main.cc:41
      07:36:06 =================================== FAILURES ===================================
      07:36:06 _________________ TestDdlStatements.test_drop_cleans_hdfs_dirs _________________
      07:36:06 [gw1] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test-s3/repos/Impala/bin/../infra/python/env/bin/python
      07:36:06 metadata/test_ddl.py:105: in test_drop_cleans_hdfs_dirs
      07:36:06     self.client.execute("drop database {0}".format(unique_database))
      07:36:06 common/impala_connection.py:160: in execute
      07:36:06     return self.__beeswax_client.execute(sql_stmt, user=user)
      07:36:06 beeswax/impala_beeswax.py:173: in execute
      07:36:06     handle = self.__execute_query(query_string.strip(), user=user)
      07:36:06 beeswax/impala_beeswax.py:337: in __execute_query
      07:36:06     handle = self.execute_query_async(query_string, user=user)
      07:36:06 beeswax/impala_beeswax.py:333: in execute_query_async
      07:36:06     return self.__do_rpc(lambda: self.imp_service.query(query,))
      07:36:06 beeswax/impala_beeswax.py:458: in __do_rpc
      07:36:06     raise ImpalaBeeswaxException(self.__build_error_message(b), b)
      07:36:06 E   ImpalaBeeswaxException: ImpalaBeeswaxException:
      07:36:06 E    INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
      07:36:06 E    MESSAGE: 
      07:36:06 E   ImpalaRuntimeException: Error making 'dropDatabase' RPC to Hive Metastore: 
      07:36:06 E   CAUSED BY: MetaException: Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
      07:36:06 E   	at org.apache.thrift.transport.TSocket.open(TSocket.java:226)
      07:36:06 E   	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:430)
      07:36:06 E   	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.reconnect(HiveMetaStoreClient.java:325)
      07:36:06 E   	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:98)
      07:36:06 E   	at com.sun.proxy.$Proxy5.dropDatabase(Unknown Source)
      07:36:06 E   	at org.apache.impala.service.CatalogOpExecutor.dropDatabase(CatalogOpExecutor.java:1160)
      07:36:06 E   	at org.apache.impala.service.CatalogOpExecutor.execDdlRequest(CatalogOpExecutor.java:278)
      07:36:06 E   	at org.apache.impala.service.JniCatalog.execDdl(JniCatalog.java:142)
      07:36:06 E   Caused by: java.net.ConnectException: Connection refused
      07:36:06 E   	at java.net.PlainSocketImpl.socketConnect(Native Method)
      07:36:06 E   	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
      07:36:06 E   	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
      07:36:06 E   	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
      07:36:06 E   	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
      07:36:06 E   	at java.net.Socket.connect(Socket.java:579)
      07:36:06 E   	at org.apache.thrift.transport.TSocket.open(TSocket.java:221)
      07:36:06 E   	... 7 more
      07:36:06 ---------------------------- Captured stderr setup -----------------------------
      07:36:06 SET sync_ddl=False;
      07:36:06 -- executing against localhost:21000
      07:36:06 DROP DATABASE IF EXISTS `test_drop_cleans_hdfs_dirs_fdfd4f8` CASCADE;
      07:36:06 
      07:36:06 SET sync_ddl=False;
      07:36:06 -- executing against localhost:21000
      07:36:06 CREATE DATABASE `test_drop_cleans_hdfs_dirs_fdfd4f8`;
      07:36:06 
      07:36:06 MainThread: Created database "test_drop_cleans_hdfs_dirs_fdfd4f8" for test ID "metadata/test_ddl.py::TestDdlStatements::()::test_drop_cleans_hdfs_dirs"
      07:36:06 ----------------------------- Captured stderr call -----------------------------
      07:36:06 -- executing against localhost:21000
      07:36:06 use default;
      07:36:06 
      07:36:06 MainThread: Resetting dropped connection: impala-cdh5-trunk.s3.amazonaws.com
      07:36:06 -- executing against localhost:21000
      07:36:06 create table test_drop_cleans_hdfs_dirs_fdfd4f8.t1(i int);
      07:36:06 
      07:36:06 -- executing against localhost:21000
      07:36:06 drop table test_drop_cleans_hdfs_dirs_fdfd4f8.t1;
      07:36:06 
      07:36:06 MainThread: Resetting dropped connection: impala-cdh5-trunk.s3.amazonaws.com
      07:36:06 -- executing against localhost:21000
      07:36:06 drop database test_drop_cleans_hdfs_dirs_fdfd4f8;
      07:36:06 
      07:36:06  generated xml file: /data/jenkins/workspace/impala-umbrella-build-and-test-s3/repos/Impala/logs/ee_tests/results/TEST-impala-parallel.xml 
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            twmarshall Thomas Tauber-Marshall
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: