Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.90.7, 0.92.2, 0.94.0, 0.95.2
    • Fix Version/s: None
    • Component/s: hbck
    • Labels:
      None

      Description

      During reviews of HBASE-5128 there are several opportunities investigate for improving the performance of the tool.

      • Change regionInfoMap and tablesInfo from TreeMap to HashMap.
      • Change some full region set reloads to be incremental to require fewer passes.
      • Cache meta for subsequent calls of closeRegionSileneglyAndWait

        Issue Links

          Activity

          Hide
          Jonathan Hsieh added a comment -

          Minor optimization:

          in HBaseFsck#loadHdfsRegionInfos we could consolidate.

          if (modTInfo = null) {
           ...
          }
          ..
          tablesInfo.put(tableNAme, modTInfo);
          

          to be

          if (modTInfo = null) {
            ...
            tablesInfo.put(tableNAme, modTInfo);
          }
          ..
          
          Show
          Jonathan Hsieh added a comment - Minor optimization: in HBaseFsck#loadHdfsRegionInfos we could consolidate. if (modTInfo = null ) { ... } .. tablesInfo.put(tableNAme, modTInfo); to be if (modTInfo = null ) { ... tablesInfo.put(tableNAme, modTInfo); } ..
          Hide
          Jonathan Hsieh added a comment -
          • parallelize the reads of .regioninfo files in the "diagnostic" section of repairs.
          Show
          Jonathan Hsieh added a comment - parallelize the reads of .regioninfo files in the "diagnostic" section of repairs.

            People

            • Assignee:
              Unassigned
              Reporter:
              Jonathan Hsieh
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Development