Details
-
Sub-task
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
A number of user pluggable code is/will use standard hadoop configuration as their means of configuration. If the DAG's (not AM) configuration is available as a byte[] payload in the appContext then it may be used as payload for user code whenever user payload is not specified. This will significantly reduce the configuration overhead and amount of code needed to write Tez jobs. Users can configure everything in their job using their local site.xml.
We could also look at creating a UserPayload object that as 2 members. 1) actual user payload byte[] if set 2) DAG configuration.