Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4904 YARN Log tooling enhancements
  3. YARN-6314

Potential infinite redirection on YARN log redirection web service

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha4
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      In YARN-6113, we have added a re-direct NM web service to get container logs which could cause the potential infinite redirection.

      It can happens when:

      • Call AHS web service to get a running/finished AM container log for a running application.
      • AHS web service would re-direct the request the specific NM given the application is still running. And the NM would handle the request
      • If the log file we requested has already been aggregated and deleted from NM, the NM would re-direct the request back to AHS.
        In this case, we would do step 2 and step 3 infinite times.

        Attachments

        1. YARN-6314.1.patch
          11 kB
          Xuan Gong
        2. YARN-6314.2.patch
          12 kB
          Xuan Gong

          Activity

            People

            • Assignee:
              xgong Xuan Gong
              Reporter:
              xgong Xuan Gong
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: