Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4012

Hadoop Job setup error leaves no useful info to users (when LinuxTaskController is used)

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.20.205.0, 1.0.0, 2.0.0-alpha
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: None
    • Labels:
      None

      Description

      When distributed cache pull fail on the TaskTracker, job webUI only shows

      Job initialization failed (255)
      

      leaving users confused.

      On the TaskTracker log, there is a log with useful info

      2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController: org.apache.hadoop.security.AccessControlException: org.apache.hadoop.security.AccessControlException: 
      Permission denied: user=user1, access=READ, inode="testfile":user3:users:rw-------
      ...
      2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.filecache.TrackerDistributedCacheManager.downloadCacheObject(TrackerDistributedCacheManager.java:415)
      ...
      2012-03-14 21:44:17,083 INFO org.apache.hadoop.mapred.TaskController:   at org.apache.hadoop.mapred.JobLocalizer.main(JobLocalizer.java:530)
      
      1. MAPREDUCE-4012.patch
        1.0 kB
        Thomas Graves
      2. mapreduce-4012-1.patch
        0.7 kB
        Koji Noguchi
      3. MAPREDUCE-4012-branch-1.patch
        0.6 kB
        Thomas Graves

        Issue Links

          Activity

          Benoy Antony made changes -
          Link This issue relates to MAPREDUCE-5589 [ MAPREDUCE-5589 ]
          Arun C Murthy made changes -
          Fix Version/s 2.0.2-alpha [ 12322471 ]
          Fix Version/s 1.0.3 [ 12320250 ]
          Matt Foley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Matt Foley made changes -
          Target Version/s 0.23.3, 1.1.0 [ 12320060, 12317960 ] 0.23.3, 1.0.3 [ 12320060, 12320250 ]
          Fix Version/s 1.0.3 [ 12320250 ]
          Fix Version/s 1.1.0 [ 12317960 ]
          Thomas Graves made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Target Version/s 2.0.0, 1.0.3 [ 12320354, 12320250 ] 1.1.0, 0.23.3 [ 12317960, 12320060 ]
          Fix Version/s 1.1.0 [ 12317960 ]
          Fix Version/s 0.23.3 [ 12320060 ]
          Resolution Fixed [ 1 ]
          Thomas Graves made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Affects Version/s 2.0.0 [ 12320354 ]
          Target Version/s 2.0.0, 1.0.3 [ 12320354, 12320250 ] 1.0.3, 2.0.0 [ 12320250, 12320354 ]
          Thomas Graves made changes -
          Attachment MAPREDUCE-4012.patch [ 12520444 ]
          Thomas Graves made changes -
          Target Version/s 1.0.3, 2.0.0 [ 12320250, 12320354 ]
          Thomas Graves made changes -
          Attachment MAPREDUCE-4012-branch-1.patch [ 12520422 ]
          Thomas Graves made changes -
          Assignee Thomas Graves [ tgraves ]
          Koji Noguchi made changes -
          Field Original Value New Value
          Attachment mapreduce-4012-1.patch [ 12518397 ]
          Koji Noguchi created issue -

            People

            • Assignee:
              Thomas Graves
              Reporter:
              Koji Noguchi
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development