Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5535 Umbrella jira for improved HDFS rolling upgrades
  3. HDFS-5498

Improve datanode startup time

          Details

          • Type: Sub-task
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: HDFS-5535 (Rolling upgrades)
          • Component/s: None
          • Labels:
            None
          • Hadoop Flags:
            Reviewed

            Description

            Similarly to HDFS-5027, an improvement can be made for getVomeMap(). This is the phase in which ReplicaMap.is populated. But it will be even better if datanode scans only once and do both.

              Attachments

              1. HDFS-5498_sh.patch
                9 kB
                Kihwal Lee
              2. HDFS-5498.with_du_change.patch
                11 kB
                Kihwal Lee
              3. HDFS-5498.with_du_change.patch
                10 kB
                Kihwal Lee

                Issue Links

                depends upon

                Improvement - An improvement or enhancement to an existing feature or task. HADOOP-10111 Allow DU to be initialized with an initial value

                • Major - Major loss of function.
                • Closed
                duplicates

                Sub-task - The sub-task of the issue HDFS-5586 Add quick-restart option for datanode

                • Major - Major loss of function.
                • Resolved
                is related to

                Improvement - An improvement or enhancement to an existing feature or task. HDFS-8710 Always read DU value from the cached "dfsUsed" file on datanode startup

                • Major - Major loss of function.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. HDFS-5027 On startup, DN should scan volumes in parallel

                • Major - Major loss of function.
                • Closed

                  Activity

                    People

                    • Assignee:
                      kihwal Kihwal Lee
                      Reporter:
                      kihwal Kihwal Lee
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      8 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: