Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-29051

Spark Application UI search is not working for some fields

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Incomplete
    • 2.4.3, 2.4.4
    • None
    • Web UI

    Description

      Spark Application UI Search is not working for some fields in Spark Web UI Executors TAB and Spark job History Server page

      Test Steps
      1.Install spark
      2.Start Spark SQL/Shell/beeline
      3.Submit some SQL queries
      4.Close some spark applications
      5.Check the Spark Web UI Executors TAB and verify search
      6.Check Spark job History Server page and verify search

      Issue 1

      Searching of some field contents are not working in Spark Web UI Executors TAB(Spark SQL/Shell/JDBC server UIs ).

      Input column(search working wrongly .Example if input is 34.5KB,searching of 34.5 won't take ,but 345 shows the search result -it is wrong)
      • Task time search is Ok, but GC time search not working
      Thread Dump -search not working [have to confirm it is required to add in search, but we are able to search stdout text in that case Thread Dump text also should be searchable ]
      Storage memory example 384.1 search not searching.

      Issue 2:

      Spark job History Server page,completed tasks- search is not working based on Duration column values. We are getting the proper search result, if we search the content from any other columns except Duration.For example if Duration is 6.1 min we can not search result for 6.1 min or even 6.1.

       

      Attachments

        1. Search Missing.png
          83 kB
          jobit mathew
        2. Search Missing.png
          83 kB
          jobit mathew
        3. Duration Search1.png
          44 kB
          jobit mathew
        4. Duration Search.png
          189 kB
          jobit mathew

        Activity

          People

            Unassigned Unassigned
            jobitmathew jobit mathew
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: