Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-574

Fix -file option in Streaming to use Distributed Cache

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • distributed-cache
    • None

    Description

      The -file option works by putting the script into the job's jar file by unjar-ing, copying and then jar-ing it again.
      We should rework the -file option to use the DistributedCache and the symlink option it provides.

      Attachments

        1. patch-2622.txt
          2 kB
          Amareshwari Sriramadasu

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-1622 Hadoop should provide a way to allow the user to specify jar file(s) the user job depends on

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              amareshwari Amareshwari Sriramadasu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: