Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-744

Support hsync in HDFS

          Details

          • Type: New Feature
          • Status: Closed
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: 2.0.2-alpha
          • Component/s: datanode, hdfs-client
          • Labels:
            None
          • Hadoop Flags:
            Reviewed

            Description

            HDFS-731 implements hsync by default as hflush. As descriibed in HADOOP-6313, the real expected semantics should be "flushes out to all replicas and all replicas have done posix fsync equivalent - ie the OS has flushed it to the disk device (but the disk may have it in its cache)." This jira aims to implement the expected behaviour.

              Attachments

              1. hdfs-744-v3.txt
                28 kB
                Lars Hofhansl
              2. hdfs-744-v2.txt
                18 kB
                Lars Hofhansl
              3. HDFS-744-trunk-v8.patch
                34 kB
                Lars Hofhansl
              4. HDFS-744-trunk-v7.patch
                34 kB
                Lars Hofhansl
              5. HDFS-744-trunk-v6.patch
                34 kB
                Lars Hofhansl
              6. HDFS-744-trunk-v5.patch
                25 kB
                Lars Hofhansl
              7. HDFS-744-trunk-v4.patch
                21 kB
                Lars Hofhansl
              8. HDFS-744-trunk-v3.patch
                20 kB
                Lars Hofhansl
              9. HDFS-744-trunk-v2.patch
                19 kB
                Lars Hofhansl
              10. HDFS-744-trunk.patch
                18 kB
                Lars Hofhansl
              11. HDFS-744-2.0-v2.patch
                34 kB
                Lars Hofhansl
              12. HDFS-744-2.0-v1.patch
                26 kB
                Lars Hofhansl
              13. hdfs-744.txt
                16 kB
                Lars Hofhansl

                Issue Links

                breaks

                Bug - A problem which impairs or prevents the functions of the product. HDFS-3721 hsync support broke wire compatibility

                • Critical - Crashes, loss of data, severe memory leak.
                • Closed
                is related to

                New Feature - A new feature of the product, which has yet to be developed. HADOOP-6313 Expose flush APIs to application users

                • Major - Major loss of function.
                • Closed

                New Feature - A new feature of the product, which has yet to be developed. HDFS-731 Support new Syncable interface in HDFS

                • Major - Major loss of function.
                • Closed
                relates to

                Bug - A problem which impairs or prevents the functions of the product. HDFS-3979 Fix hsync semantics

                • Major - Major loss of function.
                • Closed

                Improvement - An improvement or enhancement to an existing feature or task. HBASE-5954 Allow proper fsync support for HBase

                • Critical - Crashes, loss of data, severe memory leak.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. HDFS-265 Revisit append

                • Major - Major loss of function.
                • Closed

                Improvement - An improvement or enhancement to an existing feature or task. HDFS-1783 Ability for HDFS client to write replicas in parallel

                • Major - Major loss of function.
                • Patch Available

                  Activity

                    People

                    • Assignee:
                      lhofhansl Lars Hofhansl
                      Reporter:
                      hairong Hairong Kuang
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      36 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: