Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8258

Compactor cleaners can be starved on a busy table or partition.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.13.1
    • Fix Version/s: 0.14.0
    • Component/s: Transactions
    • Labels:
      None

      Description

      Currently the cleaning thread in the compactor does not run on a table or partition while any locks are held on this partition. This leaves it open to starvation in the case of a busy table or partition. It only needs to wait until all locks on the table/partition at the time of the compaction have expired. Any jobs initiated after that (and thus any locks obtained) will be for the new versions of the files.

        Attachments

        1. HIVE-8258.6.patch
          65 kB
          Alan Gates
        2. HIVE-8258.5.patch
          64 kB
          Alan Gates
        3. HIVE-8258.4.patch
          64 kB
          Alan Gates
        4. HIVE-8258.3.patch
          58 kB
          Alan Gates
        5. HIVE-8258.2.patch
          57 kB
          Alan Gates
        6. HIVE-8258.patch
          55 kB
          Alan Gates

          Activity

            People

            • Assignee:
              gates Alan Gates
              Reporter:
              gates Alan Gates
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: