Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-476

extend DistributedCache to work locally (LocalJobRunner)

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Extended DistributedCache to work with LocalJobRunner.

      Description

      The DistributedCache does not work locally when using the outlined recipe at http://hadoop.apache.org/core/docs/r0.16.0/api/org/apache/hadoop/filecache/DistributedCache.html

      Ideally, LocalJobRunner would take care of populating the JobConf and copying remote files to the local file sytem (http, assume hdfs = default fs = local fs when doing local development.

        Attachments

        1. 476.20S-2.patch
          97 kB
          Ravi Gummadi
        2. MAPREDUCE-476-v9.patch
          101 kB
          Philip Zeyliger
        3. MAPREDUCE-476-v8.patch
          100 kB
          Philip Zeyliger
        4. MAPREDUCE-476-v7.patch
          100 kB
          Philip Zeyliger
        5. v6-to-v7.patch
          13 kB
          Philip Zeyliger
        6. MAPREDUCE-476-20090818.txt
          94 kB
          Vinod Kumar Vavilapalli
        7. MAPREDUCE-476-20090814.1.txt
          94 kB
          Vinod Kumar Vavilapalli
        8. MAPREDUCE-476-v5-requires-MR711.patch
          92 kB
          Philip Zeyliger
        9. MAPREDUCE-476-v4-requires-MR711.patch
          92 kB
          Philip Zeyliger
        10. MAPREDUCE-476-v2-vs-v4.txt
          42 kB
          Philip Zeyliger
        11. MAPREDUCE-476-v3.try2.patch
          0.4 kB
          Philip Zeyliger
        12. MAPREDUCE-476-v2-vs-v3.try2.patch
          41 kB
          Philip Zeyliger
        13. MAPREDUCE-476-v3.patch
          91 kB
          Philip Zeyliger
        14. MAPREDUCE-476-v2-vs-v3.patch
          41 kB
          Philip Zeyliger
        15. MAPREDUCE-476-v2.patch
          85 kB
          Philip Zeyliger
        16. MAPREDUCE-476.patch
          24 kB
          Philip Zeyliger
        17. HADOOP-2914-v3.patch
          84 kB
          Philip Zeyliger
        18. HADOOP-2914-v2.patch
          112 kB
          Philip Zeyliger
        19. HADOOP-2914-v1-full.patch
          116 kB
          Philip Zeyliger
        20. HADOOP-2914-v1-since-4041.patch
          83 kB
          Philip Zeyliger

          Issue Links

            Activity

              People

              • Assignee:
                philip Philip Zeyliger
                Reporter:
                rash37 sam rash
              • Votes:
                2 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: