Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7054 Yarn Service Phase 2
  3. YARN-8402

Yarn Service Destroy: Delete service entries from Zookeeper in the ServiceMaster instead of ServiceClient in the RM

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      RM slows down considerably when multiple services are destroyed simultaneously.

      1. Started approx 1000 services
      2. Destroyed all the 1000 services.

      Observed considerable slowness in RM after this. 
      The ServiceClient in RM uses the CuratorClient to delete zookeeper entries. 
      The zookeeper client is the bottleneck and this could be avoided if the zookeeper entry can be deleted from the AM and then the ServiceClient can kill the app.

      Attachments

        Activity

          People

            csingh Chandni Singh
            csingh Chandni Singh
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: