Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1481

Streaming should swallow IOExceptions when closing clientOut

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.20.1, 0.21.0, 0.22.0
    • None
    • contrib/streaming
    • None

    Description

      in PipeMapRed.mapRedFinished, streaming flushes and closes clientOut_, the handle to the subprocess's stdin. If the subprocess has already exited or closed its stdin, this will generate a Broken Pipe IOException. This causes us to skip waitOutputThreads, which is incorrect, since the subprocess may have data still written from stdout that needs to be read.

      Attachments

        1. PipeMapRed.java.patch
          0.9 kB
          Vitaly
        2. TestStreamingDontConsumeInput.java
          3 kB
          Todd Lipcon

        Activity

          People

            tlipcon Todd Lipcon
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: