Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3387

A tracking URL of N/A before the app master is launched breaks oozie

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0, 2.0.0-alpha
    • Fix Version/s: 0.23.1
    • Component/s: mrv2
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution.

      Description

      When oozie launches a map/reduce job it retrieves the tracking URL of that job to display in its own UI. Previously this tracking URL did not change except when the job completed. Currently the URL starts out as N/A and then changes to the real URL once the AppMaster launches. This breaks oozie, as oozie expects to be able to get that information quickly and get back to processing other requests.

      Because the web app proxy is now available we can maintain backwards compatibility by instead of returning N/A we can return the URL of the proxy for that application. This relies on the fact that the application master's UI will display the correct thing for the URI http://<host>:<port>/, which MR and others now do.

      1. MR-3387.txt
        8 kB
        Robert Joseph Evans
      2. MR-3387.txt
        8 kB
        Robert Joseph Evans
      3. MR-3387.txt
        11 kB
        Robert Joseph Evans

        Activity

        Robert Joseph Evans created issue -
        Robert Joseph Evans made changes -
        Field Original Value New Value
        Assignee Robert Joseph Evans [ revans2 ]
        Arun C Murthy made changes -
        Target Version/s 0.23.1, 0.24.0, 0.23.0 [ 12318883, 12317654, 12315570 ] 0.23.1 [ 12318883 ]
        Robert Joseph Evans made changes -
        Attachment MR-3387.txt [ 12507216 ]
        Robert Joseph Evans made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Vinod Kumar Vavilapalli made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Robert Joseph Evans made changes -
        Attachment MR-3387.txt [ 12507371 ]
        Robert Joseph Evans made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Robert Joseph Evans made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Target Version/s 0.23.1 [ 12318883 ] 0.23.1, 0.24.0 [ 12318883, 12317654 ]
        Robert Joseph Evans made changes -
        Attachment MR-3387.txt [ 12507736 ]
        Robert Joseph Evans made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Target Version/s 0.24.0, 0.23.1 [ 12317654, 12318883 ] 0.23.1, 0.24.0 [ 12318883, 12317654 ]
        Vinod Kumar Vavilapalli made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Release Note Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution.
        Target Version/s 0.24.0, 0.23.1 [ 12317654, 12318883 ] 0.23.1, 0.24.0 [ 12318883, 12317654 ]
        Fix Version/s 0.23.1 [ 12318883 ]
        Resolution Fixed [ 1 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Allen Wittenauer made changes -
        Affects Version/s 2.0.0-alpha [ 12320354 ]
        Affects Version/s 0.24.0 [ 12317654 ]

          People

          • Assignee:
            Robert Joseph Evans
            Reporter:
            Robert Joseph Evans
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development