Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6867

For DFSOutputStream, do pipeline recovery for a single block in the background

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • hdfs-client

    Description

      For DFSOutputStream, we should be able to do pipeline recovery in the background, while the user is continuing to write to the file. This is especially useful for long-lived clients that write to an HDFS file slowly.

      Attachments

        1. HDFS-6867-design-20140820.pdf
          64 kB
          Zhe Zhang
        2. HDFS-6867-design-20140821.pdf
          69 kB
          Zhe Zhang
        3. HDFS-6867-design-20140822.pdf
          69 kB
          Zhe Zhang
        4. HDFS-6867-design-20140827.pdf
          110 kB
          Zhe Zhang
        5. HDFS-6867-20140827.patch
          11 kB
          Zhe Zhang
        6. HDFS-6867-20140827-2.patch
          13 kB
          Zhe Zhang
        7. HDFS-6867-20140827-3.patch
          12 kB
          Zhe Zhang
        8. HDFS-6867-20140828-1.patch
          13 kB
          Zhe Zhang
        9. HDFS-6867-20140828-2.patch
          14 kB
          Zhe Zhang
        10. HDFS-6867-design-20140910.pdf
          139 kB
          Zhe Zhang
        11. HDFS-6867-20140910.patch
          22 kB
          Zhe Zhang
        12. HDFS-6867-20140911.patch
          20 kB
          Zhe Zhang
        13. HDFS-6867-20140917-v1.patch
          19 kB
          Zhe Zhang
        14. HDFS-6867-20140917-v2.patch
          19 kB
          Zhe Zhang

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-3689 Add support for variable length block

          • Major - Major loss of function.
          • Closed
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-4257 The ReplaceDatanodeOnFailure policies could have a forgiving option

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              zhz Zhe Zhang
              cmccabe Colin McCabe
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated: