Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-596

INSERT cancellation tests sometimes cause HEAPCHECK failure when Impala cannot close the file

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • Impala 1.2
    • Impala 1.2
    • None
    • None

    Description

      E0919 09:58:47.413666 17335 DFSClient.java:712] Failed to close file /test-warehouse/tpch_parquet.db/ctas_cancel/.2183634468851444770-2832502054165157528_765751302_dir/2183634468851444770-2832502054165157528_1367461440_data.0
      Java exception follows:
      org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException): No lease on /test-warehouse/tpch_parquet.db/ctas_cancel/.2183634468851444770-2832502054165157528_765751302_dir/2183634468851444770-2832502054165157528_1367461440_data.0: File does not exist. Holder DFSClient_NONMAPREDUCE_-66686468_1 does not have any open files.
      	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:2445)
      	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.analyzeFileState(FSNamesystem.java:2262)
      	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:2175)
      	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:480)
      	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:299)
      	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:44954)
      	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)
      	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)
      	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1701)
      	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1697)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:396)
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
      	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1695)
      
      	at org.apache.hadoop.ipc.Client.call(Client.java:1225)
      	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
      	at $Proxy9.addBlock(Unknown Source)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      	at java.lang.reflect.Method.invoke(Method.java:597)
      	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
      	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
      	at $Proxy9.addBlock(Unknown Source)
      	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:291)
      	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1176)
      	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1029)
      	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:487)
      Leak check _main_ detected leaks of 143 bytes in 3 objects
      The 3 largest leaks:
      Using local file /data/1/jenkins/workspace/impala-master-64bit-multi/BUILD_TYPE/HEAPCHECK/label/impala-all/repos/Impala/be/build/debug/service/impalad.
      Leak of 127 bytes in 1 objects allocated from:
      	@ 369409c3c9 std::basic_string::_Rep::_S_create
      Leak of 8 bytes in 1 objects allocated from:
      	@ 7fb24f037a95 Java_com_sun_security_auth_module_UnixSystem_getUnixInfo
      Leak of 8 bytes in 1 objects allocated from:
      	@ dda349 GetDefaultDocumentRoot
      	@ ddccd6 __static_initialization_and_destruction_0
      	@ ddd225 global constructors keyed to webserver.cc
      	@ 19a6486 __do_global_ctors_aux
      	@ bc66fb _init
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            lskuff Lenni Kuff
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: