Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.14.3
    • Fix Version/s: 0.17.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      All

    • Hadoop Flags:
      Incompatible change
    • Release Note:
      Hide
      This issue restructures local job directory on the tasktracker.
      Users are provided with a job-specific shared directory (mapred-local/taskTracker/jobcache/$jobid/ work) for using it as scratch space, through configuration property and system property "job.local.dir". Now, the directory "../work" is not available from the task's cwd.
      Show
      This issue restructures local job directory on the tasktracker. Users are provided with a job-specific shared directory (mapred-local/taskTracker/jobcache/$jobid/ work) for using it as scratch space, through configuration property and system property "job.local.dir". Now, the directory "../work" is not available from the task's cwd.

      Description

      Currently, since all task cwds are created under a jobcache directory, users that need a job-specific shared directory for use as scratch space, create ../work. This is hacky, and will break when HADOOP-2115 is addressed. For such jobs, hadoop mapred should expose job.local.dir via localized configuration.

      1. patch-2116.txt
        33 kB
        Amareshwari Sriramadasu
      2. patch-2116.txt
        29 kB
        Amareshwari Sriramadasu
      3. patch-2116.txt
        6 kB
        Amareshwari Sriramadasu
      4. patch-2116.txt
        6 kB
        Amareshwari Sriramadasu
      5. patch-2116.txt
        7 kB
        Amareshwari Sriramadasu
      6. patch-2116.txt
        6 kB
        Amareshwari Sriramadasu

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Amareshwari Sriramadasu
              Reporter:
              Milind Bhandarkar
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development