Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6451

Add RM monitor validating metrics invariants

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha4
    • None
    • None
    • Reviewed

    Description

      For SLS runs, as well as for live test clusters (and maybe prod), it would be useful to have a mechanism to continuously check whether core invariants of the RM/Scheduler are respected (e.g., no priority inversions, fairness mostly respected, certain latencies within expected range, etc..)

      Attachments

        1. YARN-6451.v0.patch
          8 kB
          Carlo Curino
        2. YARN-6451.v1.patch
          12 kB
          Carlo Curino
        3. YARN-6451.v2.patch
          17 kB
          Carlo Curino
        4. YARN-6451.v3.patch
          18 kB
          Carlo Curino
        5. YARN-6451.v4.patch
          22 kB
          Carlo Curino
        6. YARN-6451.v5.patch
          22 kB
          Carlo Curino

        Issue Links

          is depended upon by

          Bug - A problem which impairs or prevents the functions of the product. YARN-6473 Create ReservationInvariantChecker to validate ReservationSystem + Scheduler operations

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. YARN-6547 Enhance SLS-based tests leveraging invariant checker

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              curino Carlo Curino
              curino Carlo Curino
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: