Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5027

On startup, DN should scan volumes in parallel

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.4-alpha
    • Fix Version/s: 2.1.0-beta
    • Component/s: datanode
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      On startup the DN must scan all replicas on all configured volumes before the initial block report to the NN. This is currently done serially, but can be done in parallel to improve startup time of the DN.

        Attachments

        1. HDFS-5027.patch
          3 kB
          Aaron Myers

          Issue Links

          relates to

          Sub-task - The sub-task of the issue HDFS-5498 Improve datanode startup time

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                atm Aaron Myers
                Reporter:
                atm Aaron Myers
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: