Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3168

reduce amount of logging in hadoop streaming

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.15.3, 0.16.0, 0.16.1, 0.16.2
    • Fix Version/s: 0.17.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Decreases the frequency of logging from streaming from every 100 records to every 10,000 records.

      Description

      logs every 100 records:

      void maybeLogRecord() {
      if (numRecRead_ >= nextRecReadLog_)

      { String info = numRecInfo(); logprintln(info); logflush(); //nextRecReadLog_ *= 10; nextRecReadLog_ += 100; }

      }

      ouch.

        Attachments

        1. patch.txt
          0.6 kB
          Zheng Shao

          Activity

            People

            • Assignee:
              zshao Zheng Shao
              Reporter:
              jsensarma Joydeep Sen Sarma
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: