HBase
  1. HBase
  2. HBASE-4583

Integrate RWCC with Append and Increment operations

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.95.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      This issue fixes MVCC issues with Increment and Append. To retain the current performance characteristics, VERSIONS should be set to 1 on column families with columns to be incremented/appended-to.
      If VERSIONS is > 1 historical versions are kept for timerange queries, but Increment/Appends will be slower due to changes accumulating the memstore leading to frequent flushes.
      Show
      This issue fixes MVCC issues with Increment and Append. To retain the current performance characteristics, VERSIONS should be set to 1 on column families with columns to be incremented/appended-to. If VERSIONS is > 1 historical versions are kept for timerange queries, but Increment/Appends will be slower due to changes accumulating the memstore leading to frequent flushes.

      Description

      Currently Increment and Append operations do not work with RWCC and hence a client could see the results of multiple such operation mixed in the same Get/Scan.
      The semantics might be a bit more interesting here as upsert adds and removes to and from the memstore.

      1. 4583.txt
        15 kB
        Lars Hofhansl
      2. 4583-mixed.txt
        18 kB
        Lars Hofhansl
      3. 4583-mixed-v2.txt
        19 kB
        Lars Hofhansl
      4. 4583-mixed-v4.txt
        19 kB
        Lars Hofhansl
      5. 4583-trunk-less-radical.txt
        12 kB
        Lars Hofhansl
      6. 4583-trunk-less-radical-v2.txt
        14 kB
        Lars Hofhansl
      7. 4583-trunk-less-radical-v3.txt
        15 kB
        Lars Hofhansl
      8. 4583-trunk-less-radical-v4.txt
        29 kB
        Lars Hofhansl
      9. 4583-trunk-less-radical-v5.txt
        29 kB
        Lars Hofhansl
      10. 4583-trunk-less-radical-v6.txt
        18 kB
        Lars Hofhansl
      11. 4583-trunk-radical_v2.txt
        24 kB
        Lars Hofhansl
      12. 4583-trunk-radical.txt
        21 kB
        Lars Hofhansl
      13. 4583-trunk-v3.txt
        27 kB
        Lars Hofhansl
      14. 4583-v2.txt
        15 kB
        Lars Hofhansl
      15. 4583-v3.txt
        24 kB
        Lars Hofhansl
      16. 4583-v4.txt
        24 kB
        Lars Hofhansl
      17. 4584-0.94-v1.txt
        23 kB
        Varun Sharma

        Issue Links

          Activity

          Lars Hofhansl created issue -
          Lars Hofhansl made changes -
          Field Original Value New Value
          Assignee Lars Hofhansl [ lhofhansl ]
          Lars Hofhansl made changes -
          Attachment 4583.txt [ 12501500 ]
          Lars Hofhansl made changes -
          Attachment 4583-v2.txt [ 12501538 ]
          Lars Hofhansl made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Lars Hofhansl made changes -
          Attachment 4583-v3.txt [ 12501555 ]
          Lars Hofhansl made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Lars Hofhansl made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Lars Hofhansl made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Lars Hofhansl made changes -
          Attachment 4583-v4.txt [ 12501559 ]
          Lars Hofhansl made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Lars Hofhansl made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.0 [ 12316419 ]
          Lars Hofhansl made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Won't Fix [ 2 ]
          Lars Hofhansl made changes -
          Resolution Won't Fix [ 2 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Lars Hofhansl made changes -
          Link This issue is related to HBASE-7051 [ HBASE-7051 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.3 [ 12323144 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          Lars Hofhansl made changes -
          Attachment 4583-trunk-radical.txt [ 12551099 ]
          Lars Hofhansl made changes -
          Status Reopened [ 4 ] Patch Available [ 10002 ]
          Lars Hofhansl made changes -
          Attachment 4583-trunk-radical_v2.txt [ 12551105 ]
          Lars Hofhansl made changes -
          Attachment 4583-trunk-v3.txt [ 12551123 ]
          Lars Hofhansl made changes -
          Attachment 4583-trunk-less-radical.txt [ 12551310 ]
          Lars Hofhansl made changes -
          Attachment 4583-trunk-less-radical-v2.txt [ 12551392 ]
          Lars Hofhansl made changes -
          Attachment 4583-trunk-less-radical-v3.txt [ 12551448 ]
          Lars Hofhansl made changes -
          Attachment 4583-trunk-less-radical-v4.txt [ 12551452 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.3 [ 12323144 ]
          Lars Hofhansl made changes -
          Attachment 4583-trunk-less-radical-v5.txt [ 12551462 ]
          Gregory Chanan made changes -
          Link This issue relates to HBASE-7076 [ HBASE-7076 ]
          Gregory Chanan made changes -
          Link This issue relates to HBASE-7077 [ HBASE-7077 ]
          Gregory Chanan made changes -
          Link This issue relates to HBASE-7078 [ HBASE-7078 ]
          Lars Hofhansl made changes -
          Attachment 4583-trunk-less-radical-v6.txt [ 12551483 ]
          Lars Hofhansl made changes -
          Link This issue relates to HBASE-7077 [ HBASE-7077 ]
          Lars Hofhansl made changes -
          Attachment 4583-mixed.txt [ 12552419 ]
          Lars Hofhansl made changes -
          Attachment 4583-mixed-v2.txt [ 12552574 ]
          Ted Yu made changes -
          Attachment 4583-mixed-v3.txt [ 12552622 ]
          Lars Hofhansl made changes -
          Release Note This issue fixes MVCC issues with Increment and Append. To retain the current performance characteristics VERSIONS should be set to 1 on column families with columns to be incremented/appended-to.
          Lars Hofhansl made changes -
          Release Note This issue fixes MVCC issues with Increment and Append. To retain the current performance characteristics VERSIONS should be set to 1 on column families with columns to be incremented/appended-to.
          This issue fixes MVCC issues with Increment and Append. To retain the current performance characteristics, VERSIONS should be set to 1 on column families with columns to be incremented/appended-to.
          Lars Hofhansl made changes -
          Attachment 4583-mixed-v4.txt [ 12552670 ]
          Ted Yu made changes -
          Attachment 4583-mixed-v3.txt [ 12552622 ]
          Lars Hofhansl made changes -
          Link This issue blocks HBASE-7141 [ HBASE-7141 ]
          Lars Hofhansl made changes -
          Release Note This issue fixes MVCC issues with Increment and Append. To retain the current performance characteristics, VERSIONS should be set to 1 on column families with columns to be incremented/appended-to.
          This issue fixes MVCC issues with Increment and Append. To retain the current performance characteristics, VERSIONS should be set to 1 on column families with columns to be incremented/appended-to.
          If VERSIONS is > 1 historical versions are kept for timerange queries, but Increment/Appends will be slower due to changes accumulating the memstore leading to frequent flushes.
          Lars Hofhansl made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Resolution Fixed [ 1 ]
          Varun Sharma made changes -
          Fix Version/s 0.94.3 [ 12323144 ]
          Varun Sharma made changes -
          Resolution Fixed [ 1 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Varun Sharma made changes -
          Status Reopened [ 4 ] Patch Available [ 10002 ]
          Varun Sharma made changes -
          Attachment 4584-0.94-v1.txt [ 12553246 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.3 [ 12323144 ]
          Lars Hofhansl made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          stack made changes -
          Fix Version/s 0.95.0 [ 12324094 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.0 [ 12316419 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.0 [ 12316419 ]
          Fix Version/s 0.94.3 [ 12323144 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.3 [ 12323144 ]
          stack made changes -
          Fix Version/s 0.98.0 [ 12323143 ]
          stack made changes -
          Fix Version/s 0.98.0 [ 12323143 ]
          Gavin made changes -
          Link This issue blocks HBASE-7141 [ HBASE-7141 ]
          Gavin made changes -
          Link This issue is depended upon by HBASE-7141 [ HBASE-7141 ]
          stack made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Lars Hofhansl made changes -
          Link This issue relates to HBASE-12931 [ HBASE-12931 ]

            People

            • Assignee:
              Lars Hofhansl
              Reporter:
              Lars Hofhansl
            • Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development