Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13717

Webhdfs api failed while uploading a tar ball

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.1.1
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Webhdfs call failed while uploading a tarball to HDFS.

      in _run_command
          raise WebHDFSCallException(err_msg, result_dict)
      resource_management.libraries.providers.hdfs_resource.WebHDFSCallException: Execution of 'curl -sS -L -w '%{http_code}' -X PUT --data-binary @/xxx/hbase.tar.gz -H 'Content-Type: application/octet-stream' --negotiate -u : -k 'https://xxx:20470/webhdfs/v1/hdp/apps/xxx/hbase/hbase.tar.gz?op=CREATE&overwrite=True&permission=444'' returned status_code=403. 
      {
        "RemoteException": {
          "exception": "IOException", 
          "javaClassName": "java.io.IOException", 
          "message": "BP-1336964058-xxx.xx.xx.xxx-1530584337961:blk_1073742195_1371 does not exist.\n\tat org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkUCBlock(FSNamesystem.java:5209)\n\tat org.apache.hadoop.hdfs.server.namenode.FSNamesystem.bumpBlockGenerationStamp(FSNamesystem.java:5281)\n\tat org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.updateBlockForPipeline(NameNodeRpcServer.java:947)\n\tat org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.updateBlockForPipeline(ClientNamenodeProtocolServerSideTranslatorPB.java:1096)\n\tat org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)\n\tat org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523)\n\tat org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991)\n\tat org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872)\n\tat org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818)\n\tat java.security.AccessController.doPrivileged(Native Method)\n\tat javax.security.auth.Subject.doAs(Subject.java:422)\n\tat org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1688)\n\tat org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678)\n"
        }
      }
       

      The tarball is uploaded to HDFS successfully. However, webhdfs api returns with HTTP 403.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              yeshavora Yesha Vora

              Dates

              • Created:
                Updated:

                Issue deployment