Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-265 Revisit append
  3. HDFS-570

When opening a file for read, make the file length avaliable to client.

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Append Branch
    • Append Branch
    • hdfs-client
    • None
    • Incompatible change, Reviewed
    • In order to support read consistency, get last block length from a data-node when opening a file being written to.

    Description

      In order to support read consistency, DFSClient needs the file length at the file opening time. In the current implmentation, DFSClient obtains the file length at the file opening time but the length is inaccurate if the file is being written.

      For more details, see Section 4 in the append design doc.

      Attachments

        1. h570_20090828.patch
          25 kB
          Tsz-wo Sze
        2. h570_20090922.patch
          15 kB
          Tsz-wo Sze
        3. h570_20090924.patch
          17 kB
          Tsz-wo Sze
        4. h570_20090925.patch
          23 kB
          Tsz-wo Sze
        5. h570_20090925b.patch
          25 kB
          Tsz-wo Sze
        6. h570_20090925c.patch
          27 kB
          Tsz-wo Sze
        7. h570_20090926.patch
          26 kB
          Konstantin Shvachko
        8. h570_20090926.patch
          26 kB
          Konstantin Shvachko

        Issue Links

        is related to

        Bug - A problem which impairs or prevents the functions of the product. HDFS-735 TestReadWhileWriting has wrong line termination symbols

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-6307 Support reading on un-closed SequenceFile

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            szetszwo Tsz-wo Sze
            szetszwo Tsz-wo Sze
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment