Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2937

Can Processor.close() be called after closing inputs and outputs?

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.7.1, 0.8.3
    • None
    • None

    Description

      Pig hit PIG-4722 as processor.close() which clears some static thread local variables was called when SpillThread was still running the Combiner. LogicalIOProcessorRuntimeTask.java calls processor.close() before closing the inputs and outputs in both close() and cleanup() methods. Can Tez change to closing the processor after the inputs and outputs are closed?

      Attachments

        1. TEZ-2937.1.patch
          3 kB
          Jonathan Turner Eagles

        Issue Links

          is required by

          Bug - A problem which impairs or prevents the functions of the product. PIG-4722 [Pig on Tez] NPE while running Combiner

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. TEZ-3974 Tez: Correctness regression of TEZ-955 in TEZ-2937

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. TEZ-3046 Compilation issue in tez-runtime-internals of branch-0.7

          • Major - Major loss of function.
          • Closed

          Activity

            People

              jeagles Jonathan Turner Eagles
              rohini Rohini Palaniswamy
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: