Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-927

DFSInputStream retries too many times for new block locations

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.20-append, 0.21.0, 0.22.0
    • 0.20.2, 0.21.0
    • hdfs-client
    • None
    • Reviewed

    Description

      I think this is a regression caused by HDFS-127 – DFSInputStream is supposed to only go back to the NN max.block.acquires times, but in trunk it goes back twice as many - the default is 3, but I am counting 7 calls to getBlockLocations before an exception is thrown.

      Attachments

        1. hdfs-927-branch-0.21.txt
          14 kB
          Todd Lipcon
        2. hdfs-927-branch0.20.txt
          13 kB
          Todd Lipcon
        3. hdfs-927.txt
          14 kB
          Todd Lipcon

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tlipcon Todd Lipcon
            tlipcon Todd Lipcon
            Votes:
            1 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment