Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4904 YARN Log tooling enhancements
  3. YARN-6314

Potential infinite redirection on YARN log redirection web service

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha4
    • None
    • None
    • Reviewed

    Description

      In YARN-6113, we have added a re-direct NM web service to get container logs which could cause the potential infinite redirection.

      It can happens when:

      • Call AHS web service to get a running/finished AM container log for a running application.
      • AHS web service would re-direct the request the specific NM given the application is still running. And the NM would handle the request
      • If the log file we requested has already been aggregated and deleted from NM, the NM would re-direct the request back to AHS.
        In this case, we would do step 2 and step 3 infinite times.

      Attachments

        1. YARN-6314.2.patch
          12 kB
          Xuan Gong
        2. YARN-6314.1.patch
          11 kB
          Xuan Gong

        Activity

          People

            xgong Xuan Gong
            xgong Xuan Gong
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: