Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15240 Go Big BucketCache Fixes
  3. HBASE-15640

L1 cache doesn't give fair warning that it is showing partial stats only when it hits limit

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0, 0.98.19, 1.2.2, 2.0.0
    • Component/s: BlockCache
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      The blockcache UI tab would stop refreshing at 100k blocks (configurable, see "hbase.ui.blockcache.by.file.max"), which isn't very many blocks when doing a big cache, giving a misleading picture of the content of L1 and/or L2 cache. Up the default limit to 1M blocks (UI takes a while but just a few seconds counting over 1M blocks).

      Also, when beyond the limit give the user a noticeable WARNING in the UI.
      Show
      The blockcache UI tab would stop refreshing at 100k blocks (configurable, see "hbase.ui.blockcache.by.file.max"), which isn't very many blocks when doing a big cache, giving a misleading picture of the content of L1 and/or L2 cache. Up the default limit to 1M blocks (UI takes a while but just a few seconds counting over 1M blocks). Also, when beyond the limit give the user a noticeable WARNING in the UI.

      Description

      I was baffled looking at L1 Cache because it was stuck at 100k blocks and only 'loading' 3G of data according to the UI. When I looked in log, all the numbers looked write in the Cache summary reported in log.

      Turns out our buckecache UI template will cut off calculating stats at a limit --which is probably what we want – but the fact that it has done this should be more plain.

        Attachments

        1. 15640.patch
          6 kB
          Michael Stack
        2. bc.ui.patch
          2 kB
          Michael Stack
        3. bc.ui.v3.patch
          2 kB
          Michael Stack
        4. bc.ui (1).patch
          2 kB
          Michael Stack
        5. Screen Shot 2016-04-12 at 4.21.50 PM.png
          30 kB
          Michael Stack

          Activity

            People

            • Assignee:
              stack Michael Stack
              Reporter:
              stack Michael Stack
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: