Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2720

Windows: Wildcard classpath variables not expanded against resources contained in archives

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.6.0
    • Component/s: nodemanager
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      On windows there are limitations to the length of command lines and environment variables which prevent placing all classpath resources into these elements. Instead, a jar containing only a classpath manifest is created to provide the classpath. During this process wildcard references are expanded by inspecting the filesystem. Since archives are extracted to a different location and linked into the final location after the classpath jar is created, resources referred to via wildcards which exist in localized archives (.zip, tar.gz) are not added to the classpath manifest jar. Since these entries are removed from the final classpath for the container they are not on the container's classpath as they should be.

        Attachments

        1. YARN-2720.2.patch
          6 kB
          Craig Welch
        2. YARN-2720.3.patch
          8 kB
          Craig Welch
        3. YARN-2720.4.patch
          8 kB
          Craig Welch

          Issue Links

            Activity

              People

              • Assignee:
                cwelch Craig Welch
                Reporter:
                cwelch Craig Welch
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: