Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6363

[NNBench] Lease mismatch error when running with multiple mappers

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Command :

      ./yarn jar ../share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.0.1-tests.jar nnbench -operation create_write -numberOfFiles 1000 -blockSize 268435456 -bytesToWrite 1024000000 -baseDir /benchmarks/NNBench`hostname -s` -replicationFactorPerFile 3 -maps 100 -reduces 10

      Trace :

      013-06-21 10:44:53,763 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 9005, call org.apache.hadoop.hdfs.protocol.ClientProtocol.addBlock from 192.168.105.214:36320: error: org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: Lease mismatch on /benchmarks/NNBenchlinux-185/data/file_linux-214__0 owned by DFSClient_attempt_1371782327901_0001_m_000048_0_1383437860_1 but is accessed by DFSClient_attempt_1371782327901_0001_m_000084_0_1880545303_1
      org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: Lease mismatch on /benchmarks/NNBenchlinux-185/data/file_linux-214__0 owned by DFSClient_attempt_1371782327901_0001_m_000048_0_1383437860_1 but is accessed by DFSClient_attempt_1371782327901_0001_m_000084_0_1880545303_1
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:2351)
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.analyzeFileState(FSNamesystem.java:2098)
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:2019)
      at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:501)
      at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:213)
      at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:52012)
      at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:435)
      at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:925)
      at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1710)
      at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1706)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)

        Attachments

        1. MAPREDUCE-6363-008.patch
          10 kB
          Bibin A Chundatt
        2. MAPREDUCE-6363-007.patch
          10 kB
          Bibin A Chundatt
        3. MAPREDUCE-6363-006.patch
          9 kB
          Bibin A Chundatt
        4. MAPREDUCE-6363-005.patch
          8 kB
          Vlad Sharanhovich
        5. MAPREDUCE-6363-004.patch
          8 kB
          Brahma Reddy Battula
        6. nnbench.log
          18 kB
          Akira Ajisaka
        7. MAPREDUCE-6363-003.patch
          8 kB
          Vlad Sharanhovich
        8. MAPREDUCE-6363-002.patch
          3 kB
          Brahma Reddy Battula
        9. MAPREDUCE-6363-001.patch
          2 kB
          Brahma Reddy Battula
        10. HDFS4929.patch
          2 kB
          Brahma Reddy Battula

          Issue Links

            Activity

              People

              • Assignee:
                bibinchundatt Bibin A Chundatt
                Reporter:
                brahmareddy Brahma Reddy Battula
              • Votes:
                2 Vote for this issue
                Watchers:
                16 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: