Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12219

Cache more efficiently getAll() and get() in FSTableDescriptors

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.94.24, 0.99.1, 0.98.6.1
    • Fix Version/s: 0.98.8, 0.99.2
    • Component/s: master
    • Labels:
    • Hadoop Flags:
      Reviewed

      Description

      Currently table descriptors and tables are cached once they are accessed for the first time. Next calls to the master only require a trip to HDFS to lookup the modified time in order to reload the table descriptors if modified. However in clusters with a large number of tables or concurrent clients and this can be too aggressive to HDFS and the master causing contention to process other requests. A simple solution is to have a TTL based cached for FSTableDescriptors#getAll() and FSTableDescriptors#TableDescriptorAndModtime() that can allow the master to process those calls faster without causing contention without having to perform a trip to HDFS for every call. to listtables() or getTableDescriptor()

        Attachments

        1. list.png
          6 kB
          Esteban Gutierrez
        2. HBASE-12219-v1.patch
          31 kB
          Matteo Bertozzi
        3. HBASE-12219-v1.patch
          31 kB
          Michael Stack
        4. HBASE-12219-0.99.v1.patch
          33 kB
          Esteban Gutierrez
        5. HBASE-12219-0.99.patch
          30 kB
          Esteban Gutierrez
        6. HBASE-12219-0.99.addendum.patch
          2 kB
          Esteban Gutierrez
        7. HBASE-12219-0.98.v1.patch
          37 kB
          Esteban Gutierrez
        8. HBASE-12219-0.98.v1.addendum.patch
          1 kB
          Esteban Gutierrez
        9. HBASE-12219-0.98.patch
          37 kB
          Esteban Gutierrez
        10. HBASE-12219-0.94.patch
          26 kB
          Esteban Gutierrez
        11. HBASE-12219.v3.patch
          31 kB
          Esteban Gutierrez
        12. HBASE-12219.v2.patch
          31 kB
          Esteban Gutierrez
        13. HBASE-12219.v0.txt
          11 kB
          Esteban Gutierrez

          Issue Links

            Activity

              People

              • Assignee:
                esteban Esteban Gutierrez
                Reporter:
                esteban Esteban Gutierrez
              • Votes:
                1 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: