Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-107

Namenode errors "Failed to complete filename.crc because dir.getFile()==null and null"

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.1.0
    • None
    • None
    • Linux

    Description

      We're getting lot of these errors and here is what I see in namenode log:

      060327 002016 Removing lease [Lease. Holder: DFSClient_1897466025, heldlocks: 0, pendingcreates: 0], leases remaining: 1
      060327 002523 Block report from member2.local:50010: 91895 blocks.
      060327 003238 Block report from member1.local:50010: 91895 blocks.
      060327 005830 Failed to complete /feedback/.feedback_10.1.10.102-33877.log.crc because dir.getFile()==null and null
      060327 005830 Server handler 1 on 50000 call error: java.io.IOException: Could not complete write to file /feedback/.feedback_10.1.10.102-33877.log.crc by DFSClient_1897466025
      java.io.IOException: Could not complete write to file /feedback/.feedback_10.1.10.102-33877.log.crc by DFSClient_1897466025
      at org.apache.hadoop.dfs.NameNode.complete(NameNode.java:205)
      at sun.reflect.GeneratedMethodAccessor38.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:585)
      at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:237)
      at org.apache.hadoop.ipc.Server$Handler.run(Server.java:216)

      I can't be 100% sure, but it looks like these errors happen with checksum files for very small data files.

      Attachments

        1. writeLocal.patch
          7 kB
          Doug Cutting

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            cutting Doug Cutting
            ibolotin Igor Bolotin
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment