Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2793 Make Pig Work on Windows without Cygwin
  3. PIG-2957

TetsScriptUDF fail due to volume prefix in jar

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • 0.12.0
    • None
    • None

    Description

      testPythonAbsolutePath fail. Stack is:
      java.io.IOException: Mkdirs failed to create C:\tmp\hadoop-Administrator\mapred\local\1_0\taskTracker\Administrator\jobcache\job_20120725074728013_0011\jars\C:\Users\Administrator\pig-monarch
      at org.apache.hadoop.util.RunJar.unJar(RunJar.java:47)
      at org.apache.hadoop.mapred.JobLocalizer.localizeJobJarFile(JobLocalizer.java:277)
      at org.apache.hadoop.mapred.JobLocalizer.localizeJobFiles(JobLocalizer.java:377)
      at org.apache.hadoop.mapred.JobLocalizer.localizeJobFiles(JobLocalizer.java:367)
      at org.apache.hadoop.mapred.DefaultTaskController.initializeJob(DefaultTaskController.java:214)
      at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1237)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1107)
      at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1212)
      at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1127)
      at org.apache.hadoop.mapred.TaskTracker$5.run(TaskTracker.java:2417)
      at java.lang.Thread.run(Thread.java:662)

      The reason is we pack the volume prefix into the job.jar.
      jar tvf C:\Users\ADMINI~1\AppData\Local\Temp\Job6350
      669482684441868.jar|grep testPythonAbsolutePath
      98 Wed Jul 25 11:12:58 PDT 2012 C:\Users\Administrator\pig-monarch\testPytho
      nAbsolutePath.py

      Attachments

        1. PIG-2957-1.patch
          2 kB
          Daniel Dai
        2. PIG-2957-2.patch
          2 kB
          Daniel Dai
        3. PIG-2957-2_0.10.patch
          2 kB
          Daniel Dai
        4. PIG-2957-3.patch
          2 kB
          Daniel Dai

        Activity

          People

            daijy Daniel Dai
            daijy Daniel Dai
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: