Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14350

Aborted txns cause false positive "Not enough history available..." msgs



    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 1.3.0, 2.1.1
    • Fix Version/s: 1.3.0, 2.1.1, 2.2.0
    • Component/s: Transactions
    • Labels:


      this is a followup to HIVE-13369. Only open txns should prevent use of a base file. But ValidTxnList does not make a distinction between open and aborted txns. The presence of aborted txns causes false positives which can happen too often since the flow is
      1. Worker generates a new base file,
      2. then asynchronously Cleaner removes now-compacted aborted txns. (strictly speaking it's Initiator that does the actual clean up)

      So we may have base_5 and base_10 and txnid 7 aborted. Then current impl will disallow use of base_10 though there is no need for that. Worse, if txnid_4 is aborted and hasn't been purged yet, base_5 will be rejected as well and then an error will be raised since there is no suitable base file left.

      ErrorMsg.ACID_NOT_ENOUGH_HISTORY is msg produced


        1. HIVE-14350.2.patch
          32 kB
          Eugene Koifman
        2. HIVE-14350.3.patch
          32 kB
          Eugene Koifman
        3. HIVE-14350.5.patch
          52 kB
          Eugene Koifman
        4. HIVE-14350.6.patch
          52 kB
          Eugene Koifman
        5. HIVE-14350.7.patch
          53 kB
          Eugene Koifman
        6. HIVE-14350.8.patch
          55 kB
          Eugene Koifman
        7. HIVE-14350.9.patch
          55 kB
          Eugene Koifman

          Issue Links



              • Assignee:
                ekoifman Eugene Koifman
                ekoifman Eugene Koifman
              • Votes:
                0 Vote for this issue
                4 Start watching this issue


                • Created: