Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8632

Threads in SLS quit without logging exception

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.2.0
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Recently, I have been using SchedulerLoadSimulator to validate the impact of changes on my FairScheduler. I encountered some problems.
      Firstly, I fix a npe bug with the patch in https://issues.apache.org/jira/browse/YARN-4302
      Secondly, everything seems to be ok, but I just get "[]" in file realtimetrack.json. Finally, I find the MetricsLogRunnable thread will exit because of npe,
      the reason is "wrapper.getQueueSet()" is still null when executing "String metrics = web.generateRealTimeTrackingMetrics();"
      So, we should put "String metrics = web.generateRealTimeTrackingMetrics();" in try section to avoid MetricsLogRunnable thread exit with unexpected exception.
      My hadoop version is 2.7.2, it seems that hadoop trunk branch also has the second problem and I have made a patch to solve it.

        Attachments

        1. YARN-8632.001.patch
          1 kB
          Xianghao Lu
        2. YARN-8632.002.patch
          1 kB
          Xianghao Lu
        3. YARN-8632.003.patch
          2 kB
          Xianghao Lu
        4. YARN-8632.004.patch
          2 kB
          Xianghao Lu
        5. YARN-8632-branch-2.7.2.001.patch
          1 kB
          Xianghao Lu

          Issue Links

            Activity

              People

              • Assignee:
                luxianghao Xianghao Lu
                Reporter:
                luxianghao Xianghao Lu
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: