Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21150

Don't block Cleaner at the end of the loop

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • 3.1.1
    • None
    • Transactions
    • None

    Description

      After HIVE-21052 the cleaner gets blocked at the end of the loop waiting for all the clean tasks to finish, once this happens it can start again and submit new clean tasks.
      The problem is that a clean tasks takes very long it will get blocked only waiting for one task, while it could submit new tasks.
      Some ideas about how to implement this in this comment

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-21052 Make sure transactions get cleaned if they are aborted before addPartitions is called

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-23324 Parallelise compaction directory cleaning process

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              jmarhuen Jaume M
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: