We have various bits and pieces of code to refresh certain configuration files, various components to restrict access to who can actually refresh the configs etc.
I propose we start thinking about a simple system to support this as a first-class citizen in Hadoop Core...