Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10519

Add a configuration option to enable in-progress edit log tailing

          Details

          • Type: Improvement
          • Status: Resolved
          • Priority: Minor
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: 3.0.0-alpha1
          • Component/s: ha
          • Labels:
            None
          • Target Version/s:
          • Release Note:
            Add a configuration option to enable in-progress edit tailing and a related unit test

            Description

            Standby Namenode has the option to do in-progress edit log tailing to improve the data freshness. In-progress tailing is already implemented, but it's not enabled as default configuration. And there's no related configuration key to turn it on.
            Adding a related configuration key to let Standby Namenode is reasonable and would be a basis for further improvement on Standby Namenode.

              Attachments

              1. HDFS-10519.013.patch
                49 kB
                Jiayi Zhou
              2. HDFS-10519.012.patch
                49 kB
                Jiayi Zhou
              3. HDFS-10519.011.patch
                49 kB
                Jiayi Zhou
              4. HDFS-10519.010.patch
                49 kB
                Jiayi Zhou
              5. HDFS-10519.009.patch
                45 kB
                Jiayi Zhou
              6. HDFS-10519.008.patch
                44 kB
                Jiayi Zhou
              7. HDFS-10519.007.patch
                43 kB
                Jiayi Zhou
              8. HDFS-10519.006.patch
                25 kB
                Jiayi Zhou
              9. HDFS-10519.005.patch
                23 kB
                Jiayi Zhou
              10. HDFS-10519.004.patch
                22 kB
                Jiayi Zhou
              11. HDFS-10519.003.patch
                7 kB
                Jiayi Zhou
              12. HDFS-10519.002.patch
                20 kB
                Jiayi Zhou
              13. HDFS-10519.001.patch
                21 kB
                Jiayi Zhou

                Issue Links

                breaks

                Bug - A problem which impairs or prevents the functions of the product. HDFS-13145 SBN crash when transition to ANN with in-progress edit tailing enabled

                • Major - Major loss of function.
                • Resolved
                is depended upon by

                New Feature - A new feature of the product, which has yet to be developed. HDFS-10702 Add a Client API and Proxy Provider to enable stale read from Standby

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Open
                is related to

                Improvement - An improvement or enhancement to an existing feature or task. HDFS-10877 Make RemoteEditLogManifest.committedTxnId optional in Protocol Buffers

                • Major - Major loss of function.
                • Resolved
                relates to

                Bug - A problem which impairs or prevents the functions of the product. HDFS-12836 startTxId could be greater than endTxId when tailing in-progress edit log

                • Major - Major loss of function.
                • Resolved

                Bug - A problem which impairs or prevents the functions of the product. HDFS-13145 SBN crash when transition to ANN with in-progress edit tailing enabled

                • Major - Major loss of function.
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. HDFS-12943 Consistent Reads from Standby Node

                • Major - Major loss of function.
                • Patch Available

                  Activity

                    People

                    • Assignee:
                      clouderajiayi Jiayi Zhou
                      Reporter:
                      clouderajiayi Jiayi Zhou
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      10 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: