[HADOOP-3203] TaskTracker::localizeJob doesn't provide the correct size to LocalDirAllocator

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.15.3
• Fix Version/s: 0.18.0
• Hadoop Flags: Reviewed
• Assignee: Amareshwari Sriramadasu
• Reporter: Christopher Douglas
• Created: 08/Apr/08 00:39
• Updated: 22/Aug/08 19:50
• Resolved: 14/May/08 13:13

Description

In TaskTracker::localizeJob:

    // Get sizes of JobFile and JarFile
    // sizes are -1 if they are not present.
    FileSystem fileSystem = FileSystem.get(fConf);
    FileStatus status[] = fileSystem.listStatus(new Path(jobFile).getParent());
    long jarFileSize = -1;
    long jobFileSize = -1;
    for(FileStatus stat : status) {
      if (stat.getPath().toString().contains("job.xml")) {
        jobFileSize = stat.getLen();
      } else {
        jobFileSize = -1;
      }
      if (stat.getPath().toString().contains("job.jar")) {
        jarFileSize = stat.getLen();
      } else {
        jarFileSize = -1;
      }
    }

One or both of jobFileSize and jarFileSize will be -1.