Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8838

Erasure Coding: Tolerate datanode failures in DFSStripedOutputStream when the data length is small

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-7285
    • hdfs-client
    • None

    Description

      Currently, DFSStripedOutputStream cannot tolerate datanode failures when the data length is small. We fix the bugs here and add more tests.

      Attachments

        1. h8838_20150729.patch
          39 kB
          Tsz-wo Sze
        2. h8838_20150731.log
          158 kB
          Walter Su
        3. h8838_20150731.patch
          45 kB
          Tsz-wo Sze
        4. h8838_20150731-HDFS-7285.patch
          45 kB
          Walter Su
        5. h8838_20150804-HDFS-7285.patch
          38 kB
          Tsz-wo Sze
        6. h8838_20150809.patch
          38 kB
          Tsz-wo Sze
        7. HDFS-8838-HDFS-7285-000.patch
          38 kB
          Tsz-wo Sze
        8. HDFS-8838-HDFS-7285-20150809.patch
          38 kB
          Tsz-wo Sze
        9. HDFS-8838-HDFS-7285-20150809-test.patch
          39 kB
          Walter Su
        10. HDFS-8838-HDFS-7285-20150821.patch
          39 kB
          Jing Zhao

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-8896 DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              szetszwo Tsz-wo Sze
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: