Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10219

ipc.Client.setupIOstreams() needs to check for ClientCache.stopClient requested shutdowns

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.2.0, 2.6.0
    • 2.10.0, 3.2.0, 2.9.2, 3.0.4, 3.1.2
    • ipc
    • None

    Description

      When ClientCache.stopClient() is called to stop the IPC client, if the client
      is blocked spinning due to a connectivity problem, it does not exit until the policy has timed out -so the stopClient() operation can hang for an extended period of time.

      This can surface in the shutdown hook of FileSystem.cache.closeAll()

      Also, Client.stop() is for used in NN switch from Standby to Active, and can therefore have very bad consequences and cause downtime.

      Attachments

        1. HADOOP-10219-branch-2.000.patch
          5 kB
          Lukas Majercak
        2. HADOOP-10219.v4.patch
          5 kB
          Lukas Majercak
        3. HADOOP-10219.v3.patch
          5 kB
          Lukas Majercak
        4. HADOOP-10219.v2.patch
          4 kB
          Lukas Majercak
        5. HADOOP-10219.v1.patch
          2 kB
          Kihwal Lee
        6. HADOOP-10219.patch
          3 kB
          Kihwal Lee

        Issue Links

        breaks

        Bug - A problem which impairs or prevents the functions of the product. HDFS-5755 Filesystem close blocks SystemExit if a DFS client is trying to talk to a nonexistent NN

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Open
        is duplicated by

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-15683 Client.setupConnection should not block Client.stop() calls

        • Critical - Crashes, loss of data, severe memory leak.
        • Resolved
        is related to

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-12464 Interrupted client may try to fail-over and retry

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-12950 ShutdownHookManager should have a timeout for each of the Registered shutdown hook

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            kihwal Kihwal Lee
            stevel@apache.org Steve Loughran
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment