Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14350

Aborted txns cause false positive "Not enough history available..." msgs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 1.3.0, 2.1.1
    • 1.3.0, 2.1.1, 2.2.0
    • Transactions
    • None

    Description

      this is a followup to HIVE-13369. Only open txns should prevent use of a base file. But ValidTxnList does not make a distinction between open and aborted txns. The presence of aborted txns causes false positives which can happen too often since the flow is
      1. Worker generates a new base file,
      2. then asynchronously Cleaner removes now-compacted aborted txns. (strictly speaking it's Initiator that does the actual clean up)

      So we may have base_5 and base_10 and txnid 7 aborted. Then current impl will disallow use of base_10 though there is no need for that. Worse, if txnid_4 is aborted and hasn't been purged yet, base_5 will be rejected as well and then an error will be raised since there is no suitable base file left.

      ErrorMsg.ACID_NOT_ENOUGH_HISTORY is msg produced

      Attachments

        1. HIVE-14350.9.patch
          55 kB
          Eugene Koifman
        2. HIVE-14350.8.patch
          55 kB
          Eugene Koifman
        3. HIVE-14350.7.patch
          53 kB
          Eugene Koifman
        4. HIVE-14350.6.patch
          52 kB
          Eugene Koifman
        5. HIVE-14350.5.patch
          52 kB
          Eugene Koifman
        6. HIVE-14350.3.patch
          32 kB
          Eugene Koifman
        7. HIVE-14350.2.patch
          32 kB
          Eugene Koifman

        Issue Links

          Activity

            People

              ekoifman Eugene Koifman
              ekoifman Eugene Koifman
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: