Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3985

Correctness: Throw a clear exception for DMEs sent during cleanup

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.10.1
    • None
    • None

    Description

      If a DME is sent during cleanup, that implies that the .close() of the LogicalIOProcessorRuntimeTask did not succeed and therefore these events are an error condition.

      These events should not be sent and more importantly should be received by the AM.

      Throw a clear exception, in case of this & allow the developers to locate the extraneous event from the backtrace.

      Attachments

        1. TEZ-3985.1.patch
          10 kB
          Jaume M
        2. TEZ-3985.2.patch
          11 kB
          Jaume M
        3. TEZ-3985.3.patch
          19 kB
          Jaume M
        4. TEZ-3985.3.patch
          19 kB
          Gopal Vijayaraghavan
        5. TEZ-3985.4.patch
          14 kB
          Gopal Vijayaraghavan
        6. TEZ-3985.5.patch
          19 kB
          Rajesh Balamohan
        7. TEZ-3985.6.patch
          20 kB
          Rajesh Balamohan
        8. TEZ-3985.7.patch
          21 kB
          Rajesh Balamohan

        Issue Links

          is depended upon by

          Bug - A problem which impairs or prevents the functions of the product. TEZ-3984 Shuffle: Out of Band DME event sending causes errors

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              jmarhuen Jaume M
              gopalv Gopal Vijayaraghavan
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: