Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-712

RandomTextWriter example is CPU bound

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.20.1, 0.21.0
    • 0.21.0
    • examples
    • None
    • ~200 nodes cluster
      Each node has the following configuration:
      Processors: 2 x Xeon L5420 2.50GHz (8 cores) - Harpertown C0, 64-bit, quad-core (8 CPUs)
      4 Disks
      16 GB RAM
      Linux 2.6
      Hadoop version: trunk

    • Reviewed

    Description

      Running the RandomTextWritter example job ( from the examples jar) pegs the machiens' CPUs.

      Attachments

        1. MR712-0.patch
          6 kB
          Christopher Douglas
        2. MR712-1.patch
          5 kB
          Christopher Douglas

        Activity

          People

            cdouglas Christopher Douglas
            khaled Khaled Elmeleegy
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: