Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0, 2.3.0
    • Fix Version/s: 2.3.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      From https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1666/console :

      Tests run: 14, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 63.12 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
      testCompletedTasksRecalculateSchedule(org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator)  Time elapsed: 2.083 sec  <<< ERROR!
      org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.lang.NullPointerException
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler.getTransferredContainers(AbstractYarnScheduler.java:50)
      	at org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService.registerApplicationMaster(ApplicationMasterService.java:277)
      	at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.register(RMCommunicator.java:154)
      	at org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator$MyContainerAllocator.register(TestRMContainerAllocator.java:1476)
      	at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.serviceStart(RMCommunicator.java:112)
      	at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.serviceStart(RMContainerAllocator.java:219)
      	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
      	at org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator$MyContainerAllocator.<init>(TestRMContainerAllocator.java:1444)
      	at org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator$RecalculateContainerAllocator.<init>(TestRMContainerAllocator.java:1629)
      	at org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator.testCompletedTasksRecalculateSchedule(TestRMContainerAllocator.java:1665)
      

      In above case getMasterContainer() returned null.

      AbstractYarnScheduler#getTransferredContainers() should check such condition.

      1. mapreduce-5719-v1.txt
        2 kB
        Ted Yu
      2. mapreduce-5719-v2.txt
        1 kB
        Ted Yu
      3. mapreduce-5719-v3.txt
        2 kB
        Ted Yu
      4. MAPREDUCE-5743.txt
        1 kB
        Vinod Kumar Vavilapalli

        Issue Links

          Activity

          Ted Yu created issue -
          Ted Yu made changes -
          Field Original Value New Value
          Attachment mapreduce-5719-v1.txt [ 12622502 ]
          Ted Yu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Zhijie Shen made changes -
          Link This issue relates to YARN-1041 [ YARN-1041 ]
          Zhijie Shen made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Zhijie Shen made changes -
          Assignee Ted Yu [ yuzhihong@gmail.com ]
          Zhijie Shen made changes -
          Affects Version/s 3.0.0 [ 12320355 ]
          Affects Version/s 2.4.0 [ 12324590 ]
          Tsuyoshi Ozawa made changes -
          Link This issue relates to YARN-1474 [ YARN-1474 ]
          Tsuyoshi Ozawa made changes -
          Hadoop Flags Reviewed [ 10343 ]
          Ted Yu made changes -
          Attachment mapreduce-5719-v2.txt [ 12623860 ]
          Ted Yu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Akira AJISAKA made changes -
          Link This issue is duplicated by MAPREDUCE-5726 [ MAPREDUCE-5726 ]
          Arun C Murthy made changes -
          Affects Version/s 2.3.0 [ 12325257 ]
          Affects Version/s 2.4.0 [ 12324590 ]
          Ted Yu made changes -
          Attachment mapreduce-5719-v3.txt [ 12626196 ]
          Vinod Kumar Vavilapalli made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Vinod Kumar Vavilapalli made changes -
          Project Hadoop Map/Reduce [ 12310941 ] Hadoop YARN [ 12313722 ]
          Key MAPREDUCE-5719 YARN-1691
          Affects Version/s 3.0.0 [ 12323268 ]
          Affects Version/s 2.3.0 [ 12325256 ]
          Affects Version/s 3.0.0 [ 12320355 ]
          Affects Version/s 2.3.0 [ 12325257 ]
          Vinod Kumar Vavilapalli made changes -
          Project Hadoop YARN [ 12313722 ] Hadoop Map/Reduce [ 12310941 ]
          Key YARN-1691 MAPREDUCE-5743
          Affects Version/s 3.0.0 [ 12320355 ]
          Affects Version/s 2.3.0 [ 12325257 ]
          Affects Version/s 3.0.0 [ 12323268 ]
          Affects Version/s 2.3.0 [ 12325256 ]
          Vinod Kumar Vavilapalli made changes -
          Summary Potential null pointer access in AbstractYarnScheduler#getTransferredContainers() TestRMContainerAllocator is failing
          Assignee Ted Yu [ yuzhihong@gmail.com ] Vinod Kumar Vavilapalli [ vinodkv ]
          Vinod Kumar Vavilapalli made changes -
          Attachment MAPREDUCE-5743.txt [ 12627295 ]
          Vinod Kumar Vavilapalli made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hadoop Flags Reviewed [ 10343 ]
          Zhijie Shen made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 2.3.0 [ 12325257 ]
          Resolution Fixed [ 1 ]
          Vinod Kumar Vavilapalli made changes -
          Assignee Vinod Kumar Vavilapalli [ vinodkv ] Ted Yu [ yuzhihong@gmail.com ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Ted Yu
              Reporter:
              Ted Yu
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development