Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4213

When the client calls hsync, allows the client to update the file length in the NameNode

          Details

          • Type: New Feature
          • Status: Closed
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: 2.0.3-alpha
          • Component/s: hdfs-client, namenode
          • Labels:
            None
          • Hadoop Flags:
            Reviewed

            Description

            As per discussion in HDFS-3960 and HDFS-2802, when clients that need strong consistency update the file length at the NameNode, a special sync/flush is required for getting the length of the being written files when snapshots are taken for these files. This jira implements this sync-with-updating-length by 1) calling ClientProtocol#fsync(), and 2) adding a new field to ClientProtocol#fsync() to indicate the length information.

              Attachments

              1. HDFS-4213.008.patch
                23 kB
                Jing Zhao
              2. HDFS-4213.007.patch
                23 kB
                Jing Zhao
              3. HDFS-4213.006.patch
                25 kB
                Jing Zhao
              4. HDFS-4213.005.patch
                25 kB
                Jing Zhao
              5. HDFS-4213.004.patch
                26 kB
                Jing Zhao
              6. HDFS-4213.003.patch
                23 kB
                Jing Zhao
              7. HDFS-4213.002.patch
                38 kB
                Jing Zhao
              8. HDFS-4213.001.patch
                37 kB
                Jing Zhao

                Issue Links

                is duplicated by

                Bug - A problem which impairs or prevents the functions of the product. HDFS-5478 File size reports as zero after writing and calling FSDataOutputStream#hsync()

                • Major - Major loss of function.
                • Resolved
                is related to

                Bug - A problem which impairs or prevents the functions of the product. HDFS-5478 File size reports as zero after writing and calling FSDataOutputStream#hsync()

                • Major - Major loss of function.
                • Resolved
                relates to

                Sub-task - The sub-task of the issue HDFS-3960 Snapshot of Being Written Files

                • Major - Major loss of function.
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. HDFS-2802 Support for RW/RO snapshots in HDFS

                • Major - Major loss of function.
                • Closed

                  Activity

                    People

                    • Assignee:
                      jingzhao Jing Zhao
                      Reporter:
                      jingzhao Jing Zhao
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      11 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: