Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9806 Allow HDFS block replicas to be provided by an external storage system
  3. HDFS-12778

[READ] Report multiple locations for PROVIDED blocks

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0
    • None
    • None
    • Reviewed

    Description

      On getBlockLocations, only one Datanode is returned as the location for all PROVIDED blocks. This can hurt the performance of applications which typically 3 locations per block. We need to return multiple Datanodes for each PROVIDED block for better application performance/resilience.

      Attachments

        1. HDFS-12778-HDFS-9806.003.patch
          20 kB
          Virajith Jalaparti
        2. HDFS-12778-HDFS-9806.002.patch
          20 kB
          Virajith Jalaparti
        3. HDFS-12778-HDFS-9806.001.patch
          14 kB
          Virajith Jalaparti

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HDFS-12809 [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              virajith Virajith Jalaparti
              virajith Virajith Jalaparti
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: