Hadoop Common
  1. Hadoop Common
  2. HADOOP-3168

reduce amount of logging in hadoop streaming

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.15.3, 0.16.0, 0.16.1, 0.16.2
    • Fix Version/s: 0.17.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Decreases the frequency of logging from streaming from every 100 records to every 10,000 records.

      Description

      logs every 100 records:

      void maybeLogRecord() {
      if (numRecRead_ >= nextRecReadLog_)

      { String info = numRecInfo(); logprintln(info); logflush(); //nextRecReadLog_ *= 10; nextRecReadLog_ += 100; }

      }

      ouch.

      1. patch.txt
        0.6 kB
        Zheng Shao

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Zheng Shao
            Reporter:
            Joydeep Sen Sarma
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development