Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23280

Trigger compaction with old aborted txns

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0-alpha-1
    • None
    • None

    Description

      When a txn is aborted and the compaction threshold for number of aborted txns is not reached then the aborted transaction can remain forever in the RDBMS database. This could result in several serious performance degradations:

      • getOpenTxns has to list this aborted txn forever
      • TXN_TO_WRITE_ID table is not cleaned

      We should add a threshold, so after a given time the compaction is started anyway.

      Attachments

        1. HIVE-23280.01.patch
          34 kB
          Karen Coppage
        2. HIVE-23280.01.patch
          34 kB
          Karen Coppage
        3. HIVE-23280.01.patch
          34 kB
          Karen Coppage
        4. HIVE-23280.01.patch
          34 kB
          Karen Coppage
        5. HIVE-23280.02.patch
          34 kB
          Karen Coppage
        6. HIVE-23280.03.patch
          35 kB
          Karen Coppage
        7. HIVE-23280.04.patch
          36 kB
          Karen Coppage
        8. HIVE-23280.04.patch
          36 kB
          Karen Coppage
        9. HIVE-23280.05.patch
          35 kB
          Karen Coppage

        Issue Links

          Activity

            People

              klcopp Karen Coppage
              klcopp Karen Coppage
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: