Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1403

Save file-sizes of each of the artifacts in DistributedCache in the JobConf

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.22.0
    • 0.21.0
    • client
    • None
    • Reviewed
    • Added private configuration variables: mapred.cache.files.filesizes and mapred.cache.archives.filesizes to store sizes of distributed cache artifacts per job. This can be used by tools like Gridmix in simulation runs.

    Description

      It would be a useful metric to collect... potentially GridMix could use it to emulate jobs which use the DistributedCache.

      Attachments

        1. mr-1403-trunk-v4.patch
          10 kB
          Luke Lu
        2. mr-1403-trunk-v3.patch
          10 kB
          Luke Lu
        3. mr-1403-trunk-v2.patch
          11 kB
          Luke Lu
        4. MR-1403-trunk-1.patch
          11 kB
          Luke Lu
        5. MAPREDUCE-1403_yhadoop20-2.patch
          7 kB
          Hemanth Yamijala
        6. MAPREDUCE-1403_yhadoop20-1.patch
          7 kB
          Hemanth Yamijala
        7. MAPREDUCE-1403_yhadoop20.patch
          7 kB
          Arun Murthy

        Activity

          People

            acmurthy Arun Murthy
            acmurthy Arun Murthy
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: