Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-26190

High rate logging of BucketAllocatorException: Allocation too big

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      These log lines may be printed at high frequency when using a schema that creates large blocks and the bucket cache is enabled. It makes sense to warn about this initially, but the very high rate of warnings when the use case is legit and this is expected does not. Print this once, then not again; or, rate-limit this message to be printed at a more reasonable rate, like once per minute.

      2021-08-11 23:42:10,902 WARN  [main-BucketCacheWriter-0]
      bucket.BucketCache: Failed allocation for 4842189251414b8a9212f6831462e415_218610843;
      org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocatorException:
      Allocation too big size=1049337;
      adjust BucketCache sizes hbase.bucketcache.bucket.sizes to accomodate
      if size seems reasonable and you want it cached.
      

      Also, it might be better to log this at INFO given the caveat "if size seems reasonable and you want it cached". Reads like an informational message.

        Attachments

          Activity

            People

            • Assignee:
              kulwantsingh011 Kulwant Singh
              Reporter:
              apurtell Andrew Kyle Purtell
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated: