Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7984

Delete registry entries from ZK on ServiceClient stop and clean up stop/destroy behavior

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.2.0, 3.1.1
    • Component/s: yarn-native-services
    • Labels:
      None

      Description

      The service records written to the registry are removed by ServiceClient on a destroy call, but not on a stop call. The service AM does have some code to clean up the registry entries when component instances are stopped, but if the AM is killed before it has a chance to perform the cleanup, these entries will be left in ZooKeeper. It would be better to clean these up in the stop call, so that RegistryDNS does not provide lookups for containers that don't exist.

      Additional stop/destroy behavior improvements include fixing errors / unexpected behavior related to:

      • destroying a saved (not launched or started) service
      • destroying a stopped service
      • destroying a destroyed service
      • returning proper exit codes for destroy failures
      • performing other client operations on saved services (fixing NPEs)

        Attachments

        1. YARN-7984.1.patch
          17 kB
          Billie Rinaldi
        2. YARN-7984.2.patch
          25 kB
          Billie Rinaldi

          Issue Links

            Activity

              People

              • Assignee:
                billie.rinaldi Billie Rinaldi
                Reporter:
                billie.rinaldi Billie Rinaldi
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: