[TWILL-131] Zookeepers nodes are not removed

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.5.0-incubating
• Fix Version/s: 0.7.0-incubating
• Component/s: discovery, zookeeper
• Assignee: Terence Yim
• Reporter: Colin B.
• Created: 27/May/15 00:51
• Updated: 20/Oct/15 20:52
• Resolved: 20/Oct/15 20:52

Description

When a TwillRunnable is run with the YarnTwillRunnerService, a zookeeper node is created and never removed.

For example run the example HelloWorld application:

java -cp $CP org.apache.twill.example.yarn.HelloWorld localhost:2181/hello

After the application had run to completion I looked at zookeeper and found:

> ./zkCli.sh ls /hello
...
[HelloWorldRunnable]

However I expected:

> ./zkCli.sh ls /hello
...
[]

This becomes an issue when a service creates a large number of TwillApplications with unique names.