Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10953

Remove single-rpc block reports.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.6.4
    • None
    • None
    • None

    Description

      Currently a DataNode can send block reports as a single RPC for all storages together or as multiple per storage RPCs. The choice is based on the size of the report and is controlled by the configuration parameter dfs.blockreport.split.threshold.
      As discussed in HDFS-10301, all block reports should be per-storage multiple RPCs.

      Attachments

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HDFS-10301 BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              shahrs87 Rushabh Shah
              shv Konstantin Shvachko
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: