Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4012

Hadoop Job setup error leaves no useful info to users (when LinuxTaskController is used)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.20.205.0, 1.0.0, 2.0.0-alpha
    • 0.23.3, 2.0.2-alpha
    • None
    • None

    Description

      When distributed cache pull fail on the TaskTracker, job webUI only shows

      Job initialization failed (255)
      

      leaving users confused.

      On the TaskTracker log, there is a log with useful info

      2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: org.apache.hadoop.security.AccessControlException: org.apache.hadoop.security.AccessControlException: 
      Permission denied: user=user1, access=READ, inode="testfile":user3:users:rw-------
      ...
      2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.filecache.TrackerDistributedCacheManager.downloadCacheObject(TrackerDistributedCacheManager.java:415)
      ...
      2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.mapred.JobLocalizer.main(JobLocalizer.java:530)
      

      Attachments

        1. mapreduce-4012-1.patch
          0.7 kB
          Koji Noguchi
        2. MAPREDUCE-4012-branch-1.patch
          0.6 kB
          Thomas Graves
        3. MAPREDUCE-4012.patch
          1.0 kB
          Thomas Graves

        Issue Links

          Activity

            People

              tgraves Thomas Graves
              knoguchi Koji Noguchi
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: