Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2384

Improve speed of block report generation

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • datanode
    • None

    Description

      This JIRA is to track a couple of potential improvements to the speed of block report generation while scanning the disks. In 0.20, the disks are scanned for every block report, though in trunk the block reports are generally built from memory.

      Attachments

        1. breport.c
          7 kB
          Todd Lipcon
        2. breport.c
          7 kB
          Todd Lipcon

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-2379 0.20: Allow block reports to proceed without holding FSDataset lock

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              Unassigned Unassigned
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: