Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2937

Can Processor.close() be called after closing inputs and outputs?

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.7.1, 0.8.3
    • None
    • None

    Description

      Pig hit PIG-4722 as processor.close() which clears some static thread local variables was called when SpillThread was still running the Combiner. LogicalIOProcessorRuntimeTask.java calls processor.close() before closing the inputs and outputs in both close() and cleanup() methods. Can Tez change to closing the processor after the inputs and outputs are closed?

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jeagles Jonathan Turner Eagles
            rohini Rohini Palaniswamy
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment