Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-26255

Add an option to use region location from meta table in TableSnapshotInputFormat

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.6
    • Fix Version/s: 3.0.0-alpha-2, 2.3.7, 2.4.7
    • Component/s: mapreduce
    • Labels:
      None

      Description

      TableSnapshotInputFormat currently calculates block locality of a region to decide the best location to run the task. While this works for a small scale table snapshot, we found that for a table snapshot with many regions, the locality calculation takes too much time. 

      In the case of a table with high locality, we can use region location from meta table to decide a snapshot region's location. Add an option to support it.

        Attachments

          Activity

            People

            • Assignee:
              huaxiangsun Huaxiang Sun
              Reporter:
              huaxiangsun Huaxiang Sun
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: