Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-38550

Use a disk-based store to save more information in live UI to help debug

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete CommentsDelete
    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.0
    • 3.4.0
    • Spark Core, SQL
    • None

    Description

      In Spark, the UI lacks troubleshooting abilities. For example:

      • AQE plan changes are not available
      • plan description of a large plan is truncated

      This is because the live UI depends on an in-memory KV store. We should always be worried

      about the stability issues when adding more information to the store.

      Therefore, it's better to add a disk-based store to save more information

      Attachments

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            linhongliu-db Linhong Liu Assign to me
            linhongliu-db Linhong Liu
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment