Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-533

Region Historian

    XMLWordPrintableJSON

Details

    • Wish
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.2.0
    • None
    • None

    Description

      Whenever we try to debug region splitting, assignment, compaction, etc. issues, we always end up having to look in 1-20 different log files for cryptic names of regions and try to piece together the chain of events ourselves. This is a challenging at best effort most of the time.

      What would be very useful would be a new utility I've nicknamed the Region Historian. You give it the text name of a region, and it will track down the log messages relevant to it in the master and regionserver logs. Then, it will interleave the messages in such a way that the timestamps correctly list the order of events. The result is a log summary that accurately describes what happened to a region during it's lifetime, making it much easier to try and figure out where something went wrong.

      Other things it could do would be replace cryptic log messages with simple events like "the region was split into a and b", "the region was assigned to server x", and trace the lineage of a region backwards to its parent before it came into existence.

      I'm sure there are other things we would think up that would be useful as well.

      Attachments

        1. hbase-533-v1.patch
          19 kB
          Jean-Daniel Cryans
        2. hbase-533-v1-fix.patch
          22 kB
          Jean-Daniel Cryans
        3. hbase-533-v2.patch
          23 kB
          Jean-Daniel Cryans
        4. hbase-533-v3.patch
          25 kB
          Jean-Daniel Cryans
        5. hbase-533-v4.patch
          55 kB
          Michael Stack
        6. hbase-533-v5.patch
          41 kB
          Jean-Daniel Cryans
        7. hbase-533-v6.patch
          52 kB
          Jean-Daniel Cryans

        Issue Links

          Activity

            People

              jdcryans Jean-Daniel Cryans
              bryanduxbury Bryan Duxbury
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: