Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1403

Save file-sizes of each of the artifacts in DistributedCache in the JobConf

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.21.0
    • Component/s: client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Added private configuration variables: mapred.cache.files.filesizes and mapred.cache.archives.filesizes to store sizes of distributed cache artifacts per job. This can be used by tools like Gridmix in simulation runs.

      Description

      It would be a useful metric to collect... potentially GridMix could use it to emulate jobs which use the DistributedCache.

        Attachments

        1. mr-1403-trunk-v4.patch
          10 kB
          Luke Lu
        2. mr-1403-trunk-v3.patch
          10 kB
          Luke Lu
        3. mr-1403-trunk-v2.patch
          11 kB
          Luke Lu
        4. MR-1403-trunk-1.patch
          11 kB
          Luke Lu
        5. MAPREDUCE-1403_yhadoop20-2.patch
          7 kB
          Hemanth Yamijala
        6. MAPREDUCE-1403_yhadoop20-1.patch
          7 kB
          Hemanth Yamijala
        7. MAPREDUCE-1403_yhadoop20.patch
          7 kB
          Arun C Murthy

          Activity

            People

            • Assignee:
              acmurthy Arun C Murthy
              Reporter:
              acmurthy Arun C Murthy
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: