GitHub user kwmonroe opened a pull request:
BIGTOP-2603: NN/RM charm should include a spark user/group
When NN/RM are not colocated with spark, they do not know about the spark user/group. When in `yarn-client` mode, the spark charm will create hdfs dirs with `spark` ACLs. This leads to errors like this on the namenode:
`WARN org.apache.hadoop.security.UserGroupInformation: No groups available for user spark`
Always create the spark user/group on NN and RM. This also works if spark/NN/RM are all colocated.
Note that `hadoop` should be a secondary group (not primary) for extra users created by these charms, so this PR ensures that as well.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/juju-solutions/bigtop bug/
Alternatively you can review and apply these changes as the patch at:
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #163
Author: Kevin W Monroe <email@example.com>
add spark user/group so they always exist on NN and RM (prevents warnings when NN/RM are not colocated with spark)