Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6307

Support reading on un-closed SequenceFile

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • io
    • None
    • Reviewed

    Description

      When a SequenceFile.Reader is constructed, it calls fs.getFileStatus(file).getLen(). However, fs.getFileStatus(file).getLen() does not return the hflushed length for un-closed file since the Namenode does not know the hflushed length. DFSClient have to ask a datanode for the length last block which is being written; see also HDFS-570.

      Attachments

        1. c6307_20091201.patch
          7 kB
          Tsz-wo Sze
        2. c6307_20091130.patch
          6 kB
          Tsz-wo Sze
        3. c6307_20091124.patch
          0.8 kB
          Tsz-wo Sze

        Issue Links

          Activity

            People

              szetszwo Tsz-wo Sze
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: