Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-17756

We should have better introspection of HFiles

    XMLWordPrintableJSON

Details

    • Brainstorming
    • Status: Closed
    • Major
    • Resolution: Implemented
    • None
    • None
    • HFile
    • None

    Description

      saint.ack@gmail.com was suggesting to use DataSketches (https://datasketches.github.io) in order to write additional statistics to the HFiles. This could be used to improve our split decisions, troubleshooting or potentially do other interesting analysis without having to perform full table scans. The statistics could be stored as part of the HFile but we could initially improve the visibility of the data by adding some statistics to HFilePrettyPrinter.

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. HBASE-9113 Expose region statistics on table.jsp

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-25641 Improve storeFile.jsp performance on really large files

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Brainstorming - A place to record back and forth on notions not yet formed enough to make a 'New Feature' or 'Task' HBASE-12311 Version stats in HFiles?

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #1727

          Web Link Performance Test Tool for HFile

          Activity

            People

              shahrs87 Rushabh Shah
              esteban Esteban Gutierrez
              Votes:
              1 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: