[HBASE-5229] Provide basic building blocks for "multi-row" local transactions.

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.94.0
• Component/s: Client, regionserver
• Hadoop Flags: Reviewed
• Assignee: Lars Hofhansl
• Reporter: Lars Hofhansl
• Created: 19/Jan/12 00:51
• Updated: 12/Oct/12 05:34
• Resolved: 08/Feb/12 18:31

Description

In the final iteration, this issue provides a generalized, public mutateRowsWithLocks method on HRegion, that can be used by coprocessors to implement atomic operations efficiently.
Coprocessors are already region aware, which makes this is a good pairing of APIs. This feature is by design not available to the client via the HTable API.

It took a long time to arrive at this and I apologize for the public exposure of my (erratic in retrospect) thought processes.

Was:
HBase should provide basic building blocks for multi-row local transactions. Local means that we do this by co-locating the data. Global (cross region) transactions are not discussed here.

After a bit of discussion two solutions have emerged:
1. Keep the row-key for determining grouping and location and allow efficient intra-row scanning. A client application would then model tables as HBase-rows.
2. Define a prefix-length in HTableDescriptor that defines a grouping of rows. Regions will then never be split inside a grouping prefix.

#1 is true to the current storage paradigm of HBase.
#2 is true to the current client side API.

I will explore these two with sample patches here.

--------------------
Was:
As discussed (at length) on the dev mailing list with the HBASE-3584 and HBASE-5203 committed, supporting atomic cross row transactions within a region becomes simple.
I am aware of the hesitation about the usefulness of this feature, but we have to start somewhere.

Let's use this jira for discussion, I'll attach a patch (with tests) momentarily to make this concrete.

Issue Links

• is related to: HBASE-5104 Provide a reliable intra-row pagination mechanism
• is related to: HBASE-4256 Intra-row scanning (part deux)
• relates to: HBASE-5257 Allow INCLUDE_AND_NEXT_COL in filters and use it in ColumnPaginationFilter
• relates to: HBASE-5542 Unify HRegion.mutateRowsWithLocks() and HRegion.processRow()

Sub-Tasks

• Add documentation for ColumnRangeFilter: Closed
• Avoid holding the rowlock during HLog sync in HRegion.mutateRowWithLocks: Closed