[YARN-6496] Rethink on configurations published into ATSv2

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Rohith Sharma K S
• Reporter: Rohith Sharma K S
• Created: 19/Apr/17 15:01
• Updated: 29/Aug/17 21:18

Description

Slider configuration model is bit different from Hadoop. Slider has configuration object with several fields differentiations such as properties, environment and files that has more functionality such as fileName, fileType, srcFile, destFile.

"configuration" : {
"properties": {
"rohith.test.properties": "inside-properties"
},
"env": {
"NUM_SHARDS": "insde-env"
}
"files" : [
{
"type": "HADOOP_XML_TEMPLATE",
"src_file": "hdfs://yclouddev/tmp/conf/core-site.xml",
"dest_file": "/etc/hadoop/conf/core-site.xml"
}]

Timeline entity config is modeled as a flattened map of String to String, that is not flexible enough to satisfy above use-case. This need to rethink how can it be modeled.