Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1403

Save file-sizes of each of the artifacts in DistributedCache in the JobConf

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.21.0
    • Component/s: client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Added private configuration variables: mapred.cache.files.filesizes and mapred.cache.archives.filesizes to store sizes of distributed cache artifacts per job. This can be used by tools like Gridmix in simulation runs.

      Description

      It would be a useful metric to collect... potentially GridMix could use it to emulate jobs which use the DistributedCache.

      1. MAPREDUCE-1403_yhadoop20.patch
        7 kB
        Arun C Murthy
      2. MAPREDUCE-1403_yhadoop20-1.patch
        7 kB
        Hemanth Yamijala
      3. MAPREDUCE-1403_yhadoop20-2.patch
        7 kB
        Hemanth Yamijala
      4. MR-1403-trunk-1.patch
        11 kB
        Luke Lu
      5. mr-1403-trunk-v2.patch
        11 kB
        Luke Lu
      6. mr-1403-trunk-v3.patch
        10 kB
        Luke Lu
      7. mr-1403-trunk-v4.patch
        10 kB
        Luke Lu

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Arun C Murthy
            Reporter:
            Arun C Murthy
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development