Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-5442 Change Data Capture
  3. PHOENIX-5435

Annotate HBase WALs with Phoenix Metadata

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      HBase write-ahead-logs (WALs) drive not only failure recovery, but HBase replication and some HBase backup frameworks. The WALs contain HBase-level metadata such as table and region, but lack Phoenix-level metadata. That means that it's quite difficult to build correct logic that needs to know about Phoenix-level constructs such as multi-tenancy, views, or indexes.

      HBASE-22622 and HBASE-22623 add the capacity for coprocessors to annotate extra key/value pairs of metadata into the HBase WAL. We should have the option to annotate the tuple <tenant_id, table-or-view-name, timestamp>, or some hashed way to reconstruct that tuple into the WAL. It should have a feature toggle so operators who don't need it don't bear the slight extra storage cost.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gjacoby Geoffrey Jacoby
                Reporter:
                gjacoby Geoffrey Jacoby
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: