Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3977

TransmitData() should not block.

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • Impala 2.7.0
    • None
    • Distributed Exec

    Description

      TransmitData() calls effectively block until an error occurs (e.g. datastream_sender_timeout_ms expires) or the RPC is serviced by the receiver.

      This is bad for a variety of reasons, not least that it makes it impossible to cancel the sender without also cancelling the recipient (who might not even be running!).

      Instead, we should have TransmitData() return control to the caller with an EAGAIN-like error so that the row batch can be resent in the future if the caller decides to do so.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sailesh Sailesh Mukil
            henryr Henry Robinson
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment