Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6615

AmIpFilter drops query parameters on redirect

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0, 2.7.3, 2.6.5, 3.0.0-alpha2
    • Fix Version/s: 2.9.0, 2.7.4, 2.6.6, 3.0.0-alpha4, 2.8.2
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      When an AM web request is redirected to the RM the query parameters are dropped from the web request.

      This happens for Spark as described in SPARK-20772.
      The repro steps are:

      • Start up the spark-shell in yarn mode and run a job
      • Try to access the job details through http://<fqdn>:4040/jobs/job?id=0
      • A HTTP ERROR 400 is thrown (requirement failed: missing id parameter)

      This works fine in local or standalone mode, but does not work on Yarn where the query parameter is dropped. If the UI filter org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter is removed from the config which shows that the problem is in the filter

        Attachments

        1. YARN-6615.1.patch
          3 kB
          Wilfred Spiegelenburg
        2. YARN-6615-branch-2.6.1.patch
          3 kB
          Wilfred Spiegelenburg
        3. YARN-6615-branch-2.6.2.patch
          3 kB
          Wilfred Spiegelenburg
        4. YARN-6615-branch-2.6.3.patch
          4 kB
          Wilfred Spiegelenburg
        5. YARN-6615-branch-2.8.1.patch
          3 kB
          Wilfred Spiegelenburg

          Issue Links

            Activity

              People

              • Assignee:
                wilfreds Wilfred Spiegelenburg
                Reporter:
                wilfreds Wilfred Spiegelenburg
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: