Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26255

Custom error/exception is not thrown for the SQL tab when UI filters are added in spark-sql launch

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.2
    • 3.0.0
    • SQL, Web UI
    • None
    • 【Test Environment】:
      Server OS :-SUSE 
      No. of Cluster Node:-3 
      Spark Version:- 2.3.2
      Hadoop Version:-3.1

    Description

      【Detailed description】:Custom error is not thrown for the SQL tab when UI filters are added in spark-sql launch
      【Precondition】:
      1.Cluster is up and running【Test step】:
      1. Launch spark sql as below:

      [spark-sql --master yarn --conf spark.ui.filters=org.apache.hadoop.security.authentication.server.AuthenticationFilter --conf spark.org.apache.hadoop.security.authentication.server.AuthenticationFilter.params="type=simple"]

      2. Go to Yarn application list UI link
      3. Launch the application master for the Spark-SQL app ID
      4. It will display an error 
      5. Append /executors, /stages, /jobs, /environment, /SQL

      【Expect Output】:An error should be displayed "An error has occurred. Please check for all the TABS 

       【Actual Output】:The error message is displayed  for all the tabs except SQL tab .

      Attachments

        1. command.png
          14 kB
          Chakravarthi
        2. logs_before_fix.png
          25 kB
          Chakravarthi
        3. ui_befofre_fix.png
          32 kB
          Chakravarthi

        Issue Links

          Activity

            People

              chakravarthi Chakravarthi
              koolsen@gmail.com Sushanta Sen
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: