Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3778

seek(long) in DFSInputStream should catch socket exception for retry later

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.16.0
    • 0.19.0
    • None
    • None
    • Reviewed

    Description

      HADOOP-2346 introduced data read/write timeout. when data stream borken, DFSClient will retry in read/write methods, but no such mechanism found when seek(long) calling blockReader.skip(diff) (DFSClient.java #1582), will let IOException throw to application. i met NPE when using MapFile in hbase.

      i'm supposing in the seek(long) method, let done be 'false' will causing retry (via 'blockEnd = -1'), a patch will attached later for review.

      Attachments

        1. HADOOP-3778.patch
          0.9 kB
          Raghu Angadi
        2. HADOOP-3778.patch
          2 kB
          Luo Ning
        3. HADOOP-3778.patch
          2 kB
          Luo Ning

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ln@webcate.net Luo Ning
            ln@webcate.net Luo Ning
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment