Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-11484

Giving precedence to proxyBase set by spark instead of env

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.6.0
    • Component/s: Web UI
    • Labels:
      None

      Description

      Customer reported a strange UI when running spark application through Oozie in Uber mode (Issue was observed only in yarn-client mode).

      When debugging the sparkUI through chrome developer console, figured out that CSS files are looked for in different applicationId (Oozie mapreduce application) instead of actual spark application. (Please see the attached screenshot for more information).

      Looking into the live sparkUI code, it seems that proxyBase is taken from APPLICATION_WEB_PROXY_BASE instead of spark property spark.ui.proxyBase (Pointing to the actual spark application). This issue might be reproducible if the above specified env is set manually or set by other job.

      Fix would be giving precedence to spark property (which might be correct in most cases when it was set).

        Attachments

          Activity

            People

            • Assignee:
              vsr Srinivasa Reddy Vundela
              Reporter:
              vsr Srinivasa Reddy Vundela
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: