Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8632

Threads in SLS quit without logging exception

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.2.0
    • None
    • Reviewed

    Description

      Recently, I have been using SchedulerLoadSimulator to validate the impact of changes on my FairScheduler. I encountered some problems.
      Firstly, I fix a npe bug with the patch in https://issues.apache.org/jira/browse/YARN-4302
      Secondly, everything seems to be ok, but I just get "[]" in file realtimetrack.json. Finally, I find the MetricsLogRunnable thread will exit because of npe,
      the reason is "wrapper.getQueueSet()" is still null when executing "String metrics = web.generateRealTimeTrackingMetrics();"
      So, we should put "String metrics = web.generateRealTimeTrackingMetrics();" in try section to avoid MetricsLogRunnable thread exit with unexpected exception.
      My hadoop version is 2.7.2, it seems that hadoop trunk branch also has the second problem and I have made a patch to solve it.

      Attachments

        1. YARN-8632.004.patch
          2 kB
          Xianghao Lu
        2. YARN-8632.003.patch
          2 kB
          Xianghao Lu
        3. YARN-8632.002.patch
          1 kB
          Xianghao Lu
        4. YARN-8632.001.patch
          1 kB
          Xianghao Lu
        5. YARN-8632-branch-2.7.2.001.patch
          1 kB
          Xianghao Lu

        Issue Links

          Activity

            People

              luxianghao Xianghao Lu
              luxianghao Xianghao Lu
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: