--- hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/Federation.md 2017-07-12 18:29:30.000000000 -0700 +++ hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/Federation_new.md 2017-07-12 18:31:16.000000000 -0700 @@ -159,7 +159,7 @@ |:---- |:---- | |`yarn.federation.enabled` | `true` | Whether federation is enabled or not | |`yarn.federation.state-store.class` | `org.apache.hadoop.yarn.server.federation.store.impl.SQLFederationStateStore` | The type of state-store to use. | -|`yarn.federation.state-store.sql.url` | `jdbc:sqlserver://:;database` | For SQLFederationStateStore the name of the DB where the state is stored. | +|`yarn.federation.state-store.sql.url` | `jdbc:sqlserver://:;databaseName=FederationStateStore` | For SQLFederationStateStore the name of the DB where the state is stored. | |`yarn.federation.state-store.sql.jdbc-class` | `com.microsoft.sqlserver.jdbc.SQLServerDataSource` | For SQLFederationStateStore the jdbc class to use. | |`yarn.federation.state-store.sql.username` | `` | For SQLFederationStateStore the username for the DB connection. | |`yarn.federation.state-store.sql.password` | `` | For SQLFederationStateStore the password for the DB connection. | @@ -222,11 +222,29 @@ | Property | Example | Description | |:---- |:---- | -|`yarn.nodemanager.amrmproxy.interceptor-class.pipeline` | `org.apache.hadoop.yarn.server.nodemanager.amrmproxy.FederationInterceptor` | A coma-separated list of interceptors to be run at the amrmproxy. For federation the last step in the pipeline should be the FederationInterceptor. | +|`yarn.nodemanager.amrmproxy.interceptor-class.pipeline` | `org.apache.hadoop.yarn.server.nodemanager.amrmproxy.FederationInterceptor` | A coma-separated list of interceptors to be run at the amrmproxy. For federation the last step in the pipeline should be the FederationInterceptor. +| 'yarn.nodemanager.amrmproxy.enabled' | true | Whether or not the AMRMProxy is enabled. +| 'yarn.client.failover.proxy-provider' | 'org.apache.hadoop.yarn.server.federation.failover.FederationRMFailoverProxyProvider' | The class +used to control the logic in the RM failover process.| Optional: | Property | Example | Description | |:---- |:---- | |`yarn.federation.statestore.max-connections` | `1` | The maximum number of parallel connections from each AMRMProxy to the state-store. This value is typically lower than the router one, since we have many AMRMProxy that could burn-through many DB connections quickly. | -|`yarn.federation.cache-ttl.secs` | `300` | The time to leave for the AMRMProxy cache. Typically larger than at the router, as the number of AMRMProxy is large, and we want to limit the load to the centralized state-store. | \ No newline at end of file +|`yarn.federation.cache-ttl.secs` | `300` | The time to leave for the AMRMProxy cache. Typically larger than at the router, as the number of AMRMProxy is large, and we want to limit the load to the centralized state-store. | + +Operation +========= +In order to submit jobs to a Federation cluster one must create a seperate set of configs for the client from which said jobs will be +submitted. In these, the **conf/yarn-site.xml** should have the following configs: + +| Property | Example | Description | +|:--- |:--- | +| yarn.resourcemanager.address | :8050 | Redirects jobs launched at the client to the router port. +| yarn.resourcemanger.scheduler.address | :8049 | Redirects jobs to the router's scheduler.| + +In order to launch the router, you must run $HADOOP_HOME/bin/yarn --daemon start router from the router machine. Any YARN jobs for the +cluster can be +submitted from the client configurations described above. +