Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3626

On Windows localized resources are not moved to the front of the classpath when they should be

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 2.7.1, 3.0.0-alpha1
    • Component/s: yarn
    • Labels:
      None
    • Environment:

      Windows

    • Hadoop Flags:
      Reviewed

      Description

      In response to the mapreduce.job.user.classpath.first setting the classpath is ordered differently so that localized resources will appear before system classpath resources when tasks execute. On Windows this does not work because the localized resources are not linked into their final location when the classpath jar is created. To compensate for that localized jar resources are added directly to the classpath generated for the jar rather than being discovered from the localized directories. Unfortunately, they are always appended to the classpath, and so are never preferred over system resources.

        Attachments

        1. YARN-3626.0.patch
          6 kB
          Craig Welch
        2. YARN-3626.11.patch
          7 kB
          Craig Welch
        3. YARN-3626.14.patch
          9 kB
          Craig Welch
        4. YARN-3626.15.patch
          9 kB
          Craig Welch
        5. YARN-3626.16.patch
          9 kB
          Craig Welch
        6. YARN-3626.4.patch
          13 kB
          Craig Welch
        7. YARN-3626.6.patch
          13 kB
          Craig Welch
        8. YARN-3626.9.patch
          6 kB
          Craig Welch

          Issue Links

            Activity

              People

              • Assignee:
                cwelch Craig Welch
                Reporter:
                cwelch Craig Welch
              • Votes:
                1 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: