Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-265 Revisit append
  3. HDFS-570

When opening a file for read, make the file length avaliable to client.

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Append Branch
    • Fix Version/s: Append Branch
    • Component/s: hdfs-client
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      In order to support read consistency, get last block length from a data-node when opening a file being written to.

      Description

      In order to support read consistency, DFSClient needs the file length at the file opening time. In the current implmentation, DFSClient obtains the file length at the file opening time but the length is inaccurate if the file is being written.

      For more details, see Section 4 in the append design doc.

        Attachments

        1. h570_20090828.patch
          25 kB
          Tsz-wo Sze
        2. h570_20090922.patch
          15 kB
          Tsz-wo Sze
        3. h570_20090924.patch
          17 kB
          Tsz-wo Sze
        4. h570_20090925.patch
          23 kB
          Tsz-wo Sze
        5. h570_20090925b.patch
          25 kB
          Tsz-wo Sze
        6. h570_20090925c.patch
          27 kB
          Tsz-wo Sze
        7. h570_20090926.patch
          26 kB
          Konstantin Shvachko
        8. h570_20090926.patch
          26 kB
          Konstantin Shvachko

          Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-735 TestReadWhileWriting has wrong line termination symbols

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-6307 Support reading on un-closed SequenceFile

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                szetszwo Tsz-wo Sze
                Reporter:
                szetszwo Tsz-wo Sze
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: