Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.16.0
    • Fix Version/s: 0.16.0
    • Component/s: None
    • Labels:
      None

      Description

      Today, the map task stops calling the map method while sort/spill is using the (single instance of) map output buffer. One improvement that can be done to improve performance of the map task is to have another buffer for writing the map outputs to, while sort/spill is using the first buffer.

        Attachments

        1. HADOOP-2419.patch
          30 kB
          Amar Kamat
        2. HADOOP-2419.patch
          34 kB
          Amar Kamat
        3. HADOOP-2419.patch
          29 kB
          Amar Kamat
        4. HADOOP-2419.patch
          29 kB
          Amar Kamat
        5. HADOOP-1965-Benchmark.patch
          28 kB
          Amar Kamat
        6. HADOOP-1965-Benchmark.patch
          28 kB
          Amar Kamat
        7. HADOOP-1965-Benchmark.patch
          28 kB
          Amar Kamat
        8. HADOOP-1965-Benchmark.patch
          27 kB
          Amar Kamat
        9. HADOOP-1965-Benchmark.patch
          24 kB
          Amar Kamat
        10. HADOOP-1965-1.patch
          8 kB
          Amar Kamat
        11. 1965_single_proc_150mb_gziped.jpeg
          81 kB
          Amar Kamat
        12. 1965_single_proc_150mb_gziped_breakup.png
          5 kB
          Amar Kamat
        13. 1965_single_proc_150mb_gziped.pdf
          2 kB
          Amar Kamat

          Activity

            People

            • Assignee:
              amar_kamat Amar Kamat
              Reporter:
              devaraj Devaraj Das
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: