Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2617

Build failed to copy data to HDFS

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: Impala 2.3.0
    • Fix Version/s: None
    • Component/s: None

      Description

      http://sandbox.jenkins.cloudera.com/job/impala-cdh5.5.x-exhaustive/54/console

      06:35:51 Copying data to hdfs
      06:48:03 2015-10-29 06:48:03,795 INFO  [Thread-10656] hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1595)) - Exception in createBlockOutputStream
      06:48:03 java.io.EOFException: Premature EOF: no length prefix available
      06:48:03 	at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:2241)
      06:48:03 	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1563)
      06:48:03 	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1483)
      06:48:03 	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:668)
      06:48:03 2015-10-29 06:48:03,800 INFO  [Thread-10656] hdfs.DFSClient (DFSOutputStream.java:nextBlockOutputStream(1486)) - Abandoning BP-889396575-127.0.0.1-1446125281693:blk_1073747750_6926
      06:48:03 2015-10-29 06:48:03,806 INFO  [Thread-10656] hdfs.DFSClient (DFSOutputStream.java:nextBlockOutputStream(1490)) - Excluding datanode DatanodeInfoWithStorage[127.0.0.1:31001,DS-1958e724-1a04-4f23-a27d-435e6a718058,DISK]
      06:48:03 2015-10-29 06:48:03,823 INFO  [Thread-10656] hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1595)) - Exception in createBlockOutputStream
      06:48:03 java.io.EOFException: Premature EOF: no length prefix available
      06:48:03 	at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:2241)
      06:48:03 	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1563)
      06:48:03 	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1483)
      06:48:03 	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:668)
      06:48:03 2015-10-29 06:48:03,823 INFO  [Thread-10656] hdfs.DFSClient (DFSOutputStream.java:nextBlockOutputStream(1486)) - Abandoning BP-889396575-127.0.0.1-1446125281693:blk_1073747751_6927
      06:48:03 2015-10-29 06:48:03,824 INFO  [Thread-10656] hdfs.DFSClient (DFSOutputStream.java:nextBlockOutputStream(1490)) - Excluding datanode DatanodeInfoWithStorage[127.0.0.1:31002,DS-ecda4036-1cf9-47cb-944c-6467ffd56724,DISK]
      06:48:03 2015-10-29 06:48:03,837 INFO  [Thread-10656] hdfs.DFSClient (DFSOutputStream.java:createBlockOutputStream(1595)) - Exception in createBlockOutputStream
      06:48:03 java.io.EOFException: Premature EOF: no length prefix available
      06:48:03 	at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:2241)
      06:48:03 	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1563)
      06:48:03 	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1483)
      06:48:03 	at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:668)
      06:48:03 2015-10-29 06:48:03,837 INFO  [Thread-10656] hdfs.DFSClient (DFSOutputStream.java:nextBlockOutputStream(1486)) - Abandoning BP-889396575-127.0.0.1-1446125281693:blk_1073747752_6928
      06:48:03 2015-10-29 06:48:03,838 INFO  [Thread-10656] hdfs.DFSClient (DFSOutputStream.java:nextBlockOutputStream(1490)) - Excluding datanode DatanodeInfoWithStorage[127.0.0.1:31000,DS-c3d0887b-f95b-4e80-a5fe-fc5ecbe325ea,DISK]
      06:48:03 2015-10-29 06:48:03,848 WARN  [Thread-10656] hdfs.DFSClient (DFSOutputStream.java:run(790)) - DataStreamer Exception
      06:48:03 org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /test-warehouse/visa.osvmain_seq_snap/000002_0._COPYING_ could only be replicated to 0 nodes instead of minReplication (=1).  There are 3 datanode(s) running and 3 node(s) are excluded in this operation.
      06:48:03 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1557)
      06:48:03 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3286)
      06:48:03 	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:676)
      06:48:03 	at org.apache.hadoop.hdfs.server.namenode.AuthorizationProviderProxyClientProtocol.addBlock(AuthorizationProviderProxyClientProtocol.java:212)
      06:48:03 	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:483)
      06:48:03 	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
      06:48:03 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:617)
      06:48:03 	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1060)
      06:48:03 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2086)
      06:48:03 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2082)
      06:48:03 	at java.security.AccessController.doPrivileged(Native Method)
      06:48:03 	at javax.security.auth.Subject.doAs(Subject.java:415)
      06:48:03 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
      06:48:03 	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2080)
      

      The console output contains a lot more similar exceptions.

      The build also failed to archive test results (IMPALA-2616).

      ERROR: Failed to archive test reports
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              skye Skye Wanderman-Milne
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: