Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3760

FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.4.0
    • Fix Version/s: 2.9.0, 3.0.0-alpha4, 2.8.2
    • Component/s: nodemanager
    • Labels:
      None

      Description

      The aggregated log file does not appear to be properly closed when writes fail. This leaves a lease renewer active in the NM that spams the NN with lease renewals. If the token is marked not to be cancelled, the renewals appear to continue until the token expires. If the token is cancelled, the periodic renew spam turns into a flood of failed connections until the lease renewer gives up.

        Attachments

        1. YARN-3760.02.patch
          1 kB
          Haibo Chen
        2. YARN-3760.01.patch
          1.0 kB
          Haibo Chen
        3. YARN-3760.00.patch
          0.9 kB
          Haibo Chen

          Issue Links

            Activity

              People

              • Assignee:
                haibochen Haibo Chen
                Reporter:
                daryn Daryn Sharp
              • Votes:
                0 Vote for this issue
                Watchers:
                17 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: