Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18547

WM: trigger test may fail

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • None
    • None

    Description

      https://builds.apache.org/job/PreCommit-HIVE-Build/8818/testReport/org.apache.hive.jdbc/TestTriggersMoveWorkloadManager/testTriggerMoveAndKill/

      Looks like the cluster allocation assignment and WM event creation race, probably because WM returns session to the caller ASAP and then makes the changes after that.

      'Event: GET Pool: BI Cluster %: 80.00' expected in STDERR capture, but not found.
      
      ... 
      
      2018-01-24T15:07:31,746  INFO [Workload management master] tez.WorkloadManager: Processing changes for pool BI: [BI, query parallelism 1, fraction of the cluster 0.800000011920929, fraction used by child pools 0.0, active sessions 0, initializing sessions 0]
      2018-01-24T15:07:31,746  INFO [Workload management master] tez.WorkloadManager: Starting 1 queries in pool [BI, query parallelism 1, fraction of the cluster 0.800000011920929, fraction used by child pools 0.0, active sessions 0, initializing sessions 0]
      2018-01-24T15:07:31,746  INFO [Workload management master] tez.WorkloadManager: Received a session from AM pool sessionId=2be29c62-9f2c-40b7-a5eb-6298baf83a34, queueName=default, user=hiveptest, doAs=false, isOpen=true, isDefault=true, expires in 588529859ms, WM state poolName=null, clusterFraction=0.0, queryId=null, killReason=null
      2018-01-24T15:07:31,746  INFO [HiveServer2-Background-Pool: Thread-1377] tez.WmEvent: Added WMEvent: EventType: GET EventStartTimestamp: 1516835251746 elapsedTime: 0 wmTezSessionInfo:SessionId: 2be29c62-9f2c-40b7-a5eb-6298baf83a34 Pool: BI Cluster %: 0.0
      2018-01-24T15:07:31,746  INFO [Workload management master] tez.GuaranteedTasksAllocator: Updating 2be29c62-9f2c-40b7-a5eb-6298baf83a34 with 3 guaranteed tasks
      

      Attachments

        1. HIVE-18547.2.patch
          3 kB
          Prasanth Jayachandran
        2. HIVE-18547.1.patch
          4 kB
          Prasanth Jayachandran

        Activity

          People

            prasanth_j Prasanth Jayachandran
            sershe Sergey Shelukhin
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: