Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19077

Handle duplicate ptests requests standing in queue at the same time

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: Testing Infrastructure
    • Labels:
      None

      Description

      I've been keeping on eye on our PreCommit-HIVE-Build job, and what I noticed that sometimes huge queues can build up, that contain jira's more than once. (Yesterday I've seen a queue of 40, having 31 distinct jiras..)

      Simple scenario is that I upload a patch, it gets queued for ptest (already long queue), and 3 hours later I will update it, re-upload and re-queue. Now the current ptest infra seems to be smart enough to always deal with the latest patch, so what will happen is that the same patch will be tested 2 times (with ~3 hours) diff, most probably with same result.

      I propose we do some deduplication - if ptest starts running the request for Jira X, then it can take a look on the current queue, and see if X is there again. If so, it can skip for now, it will be picked up later anyway.

      In practice this means that if you reconsider your patch and update it, your original place in the queue will be gone (like as a penalty for changing it), but overall it saves resources for the whole community.

        Attachments

        1. HIVE-19077.0.patch
          9 kB
          Ádám Szita
        2. HIVE-19077.1.patch
          10 kB
          Ádám Szita
        3. HIVE-19077.2.patch
          18 kB
          Ádám Szita
        4. HIVE-19077.overrideoption.patch
          5 kB
          Ádám Szita
        5. HIVE-19077.sslFix.patch
          3 kB
          Ádám Szita

          Activity

            People

            • Assignee:
              szita Ádám Szita
              Reporter:
              szita Ádám Szita
            • Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: