Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: task
    • Labels:
      None
    • Target Version/s:

      Description

      Local map segments should never be handled as though they were remote (i.e., copied through a servlet to local disk). This optimization is uniformally more efficient for the fetch, though it increases the number of on-disk segments. Each segment has its own overhead, which can exceed the cost of pulling it into memory (e.g., the decompressor overhead for an active segment exceeds the cost of decompression into memory). Some logic is required to handle a large number of such segments.

        Issue Links

          Activity

          Chris Douglas created issue -
          Chris Douglas made changes -
          Field Original Value New Value
          Link This issue is part of MAPREDUCE-4584 [ MAPREDUCE-4584 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Chris Douglas
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:

                Development