Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28638

Task summary metrics are wrong when there are running tasks

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 2.4.4, 3.0.0
    • Component/s: Web UI
    • Labels:
      None

      Description

      Currently, on requesting summary metrics, cached data are returned if the current number of successful tasks is the same as the cached data.
      However, the number of successful tasks is wrong. In `AppStatusStore`, the KVStore is ElementTrackingStore, instead of InMemoryStore. This PR is to fix the class matching.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Gengliang.Wang Gengliang Wang
                Reporter:
                Gengliang.Wang Gengliang Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: