Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-341

Remote profiles may be ignored by coordinator if query has a limit

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      For a query with a LIMIT, the coordinator cancels remote fragments once the limit has been reached. This can happen before the backends have successfully sent a profile update, and any subsequent updates are ignored because the query is cancelled, so the complete profile is never fleshed out.

      When the query is an INSERT, it is possible that a race in the coordinator code handling the remote profiles leads to a crash. This only seems to happen occasionally with large clusters (as reported), and we haven't been able to reproduce this internally yet.

      We should probably wait until all backends have completed one way or the other before tearing down a query completely.

      A workaround is to remove the LIMIT.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            twmarshall Thomas Tauber-Marshall
            henryr Henry Robinson
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment