Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6241

Timeout in TestAdmissionControllerStress.test_mem_limit under ASAN

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 2.11.0
    • Impala 2.11.0
    • None
    • ghx-label-3

    Description

      In an ASAN build, test_mem_limit times out in end_admitted_queries(). It's probably related to IMPALA-6227

          def end_admitted_queries(self, num_queries):
            """
              Requests each admitted query to end its query.
              """
            assert len(self.executing_threads) >= num_queries
            LOG.debug("Requesting {0} clients to end queries".format(num_queries))
          
            # Request admitted clients to end their queries
            current_executing_queries = []
            for i in xrange(num_queries):
              # pop() is thread-safe, it's OK if another thread is appending concurrently.
              thread = self.executing_threads.pop(0)
              LOG.debug("Cancelling query %s", thread.query_num)
              assert thread.query_state == 'ADMITTED'
              current_executing_queries.append(thread)
              thread.query_state = 'REQUEST_QUERY_END'
          
            # Wait for the queries to end
            start_time = time()
            while True:
              all_done = True
              for thread in self.all_threads:
                if thread.query_state == 'REQUEST_QUERY_END':
                  all_done = False
              if all_done:
                break
      >       assert (time() - start_time < STRESS_TIMEOUT),\
                "Timed out waiting %s seconds for query end" % (STRESS_TIMEOUT,)
      E       AssertionError: Timed out waiting 60 seconds for query end
      E       assert (1511608615.681211 - 1511608555.6205289) < 60
      E        +  where 1511608615.681211 = time()
      custom_cluster/test_admission_controller.py:623: AssertionError
      

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tarmstrong Tim Armstrong
            tianyiwang Tianyi Wang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment