Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1151

streaming PipeMapRed prints system info to stderr

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Trivial
    • Resolution: Fixed
    • None
    • 0.13.0
    • None
    • None

    Description

      In streaming, user task's stderr is filled with following output from the streaming infrastructure.

      R/W/S=4316801/4316308/0 in:73166=4316801/59 [rec/s] out:73157=4316308/59 [rec/s]
      R/W/S=4316901/4316424/0 in:73167=4316901/59 [rec/s] out:73159=4316425/59 [rec/s]
      R/W/S=4317001/4316470/0 in:73169=4317001/59 [rec/s] out:73160=4316470/59 [rec/s]
      R/W/S=4317101/4316723/0 in:73171=4317101/59 [rec/s] out:73164=4316724/59 [rec/s]
      R/W/S=4317201/4316772/0 in:73172=4317201/59 [rec/s] out:73165=4316773/59 [rec/s]
      R/W/S=4317301/4316905/0 in:73174=4317301/59 [rec/s] out:73167=4316905/59 [rec/s]
      R/W/S=4317401/4316946/0 in:73176=4317401/59 [rec/s] out:73168=4316946/59 [rec/s]

      This can hit the size limit and delete users' actual stderr messages.

      Attachments

        1. 1151.patch
          0.5 kB
          Koji Noguchi

        Activity

          People

            knoguchi Koji Noguchi
            knoguchi Koji Noguchi
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: