Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4233 YARN Timeline Service plugin: ATS v1.5
  3. YARN-4696

Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: timelineserver
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      EntityGroupFSTimelineStore now depends on an RM being up and running; the configuration pointing to it. This is a new change, and impacts testing where you have historically been able to test without an RM running.

      The sole purpose of the probe is to automatically determine if an app is running; it falls back to "unknown" if not. If the RM connection was optional, the "unknown" codepath could be called directly, relying on age of file as a metric of completion

      Options

      1. add a flag to disable RM connect
      2. skip automatically if RM not defined/set to 0.0.0.0
      3. disable retries on yarn client IPC; if it fails, tag app as unknown.

        Attachments

        1. YARN-4696-001.patch
          12 kB
          Steve Loughran
        2. YARN-4696-002.patch
          16 kB
          Steve Loughran
        3. YARN-4696-003.patch
          18 kB
          Steve Loughran
        4. YARN-4696-005.patch
          22 kB
          Steve Loughran
        5. YARN-4696-006.patch
          29 kB
          Steve Loughran
        6. YARN-4696-007.patch
          33 kB
          Steve Loughran
        7. YARN-4696-008.patch
          31 kB
          Steve Loughran
        8. YARN-4696-009.patch
          31 kB
          Steve Loughran
        9. YARN-4696-010.patch
          30 kB
          Steve Loughran
        10. YARN-4696-012.patch
          31 kB
          Steve Loughran
        11. YARN-4696-013.patch
          37 kB
          Steve Loughran
        12. YARN-4696-014.patch
          39 kB
          Steve Loughran

          Issue Links

            Activity

              People

              • Assignee:
                stevel@apache.org Steve Loughran
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: