Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18320 Support ACID Tables Replication
  3. HIVE-18192

Introduce WriteID per table rather than using global transaction ID

    XMLWordPrintableJSON

Details

    Description

      To support ACID replication, we will be introducing a per table write Id which will replace the transaction id in the primary key for each row in a ACID table.

      The current primary key is determined via
      <original transaction id, bucketid , rowid>

      which will move to
      <original write id, bucketid, rowid>

      For each table modified by the given transaction will have a table level write ID allocated and a persisted map of global txn id -> to table -> write id for that table has to be maintained to allow Snapshot isolation.

      Readers should use the combination of ValidTxnList and ValidWriteIdList(Table) for snapshot isolation.

       

       Hive Replication - ACID Tables.pdf has a section "Per Table Sequences (Write-Id)" with more detials

      Attachments

        1. HIVE-18192.01.patch
          1.80 MB
          Sankar Hariappan
        2. HIVE-18192.02.patch
          1.92 MB
          Sankar Hariappan
        3. HIVE-18192.03.patch
          2.01 MB
          Sankar Hariappan
        4. HIVE-18192.04.patch
          2.02 MB
          Sankar Hariappan
        5. HIVE-18192.05.patch
          2.05 MB
          Sankar Hariappan
        6. HIVE-18192.06.patch
          2.05 MB
          Sankar Hariappan
        7. HIVE-18192.07.patch
          2.13 MB
          Sankar Hariappan
        8. HIVE-18192.08.patch
          2.13 MB
          Sankar Hariappan
        9. HIVE-18192.09.patch
          1.99 MB
          Sankar Hariappan
        10. HIVE-18192.10.patch
          2.03 MB
          Sankar Hariappan
        11. HIVE-18192.11.patch
          2.05 MB
          Sankar Hariappan
        12. HIVE-18192.12.patch
          2.09 MB
          Sankar Hariappan
        13. HIVE-18192.13.patch
          2.10 MB
          Sankar Hariappan
        14. HIVE-18192.14.patch
          2.10 MB
          Sankar Hariappan
        15. HIVE-18192.15.patch
          2.15 MB
          Sankar Hariappan
        16. HIVE-18192.16.patch
          2.15 MB
          Sankar Hariappan
        17. HIVE-18192.17.patch
          2.15 MB
          Sankar Hariappan

        Issue Links

          Activity

            People

              sankarh Sankar Hariappan
              anishek Anishek Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: