[AMBARI-21708] History Server cannot be started due to wrong permissions of /mr-history

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: ambari-server
• Assignee: Attila Doroszlai
• Reporter: Attila Doroszlai
• Created: 11/Aug/17 08:08
• Updated: 14/Aug/17 07:57
• Resolved: 14/Aug/17 07:23

Description

Steps to reproduce:

1. Install Ambari from trunk
2. Create cluster with MapReduce2

Result: History Server becomes stopped after starting it.

During startup History Server tries to create /mr-history/tmp, but fails:

mapred-mapred-historyserver.log

2017-08-09 11:54:20,957 INFO  service.AbstractService (AbstractService.java:noteFailure(272)) - Service org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Error creating intermediate done directory
...
Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=mapred, access=WRITE, inode="/mr-history/tmp":hdfs:hdfs:drwxr-xr-x
...
2017-08-09 11:54:20,971 INFO  util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting with status -1

Caused by wrong permissions on /mr-history:

trunk

drwxr-xr-x   - hdfs   hdfs            0 2017-08-09 11:54 /mr-history
drwxrwxrwx   - mapred hadoop          0 2017-08-09 11:54 /mr-history/done

branch-2.5

drwxrwxrwx   - mapred hadoop          0 2017-08-09 12:26 /mr-history
drwxrwxrwx   - mapred hadoop          0 2017-08-09 12:26 /mr-history/done
drwxrwxrwt   - mapred hadoop          0 2017-08-09 12:26 /mr-history/tmp

In AMBARI-21116 recursive permissions were eliminated for the wrong directory in YARN/2.1.0.2.0: mapreduce_jobhistory_done_dir instead of node_labels_dir.

Compare:

YARN/2.1.0.2.0/package/scripts/yarn.py

   params.HdfsResource(params.mapreduce_jobhistory_done_dir,
                        type="directory",
                         action="create_on_execute",
                         owner=params.mapred_user,
                         group=params.user_group,
 -                       change_permissions_for_parents=True,
                         mode=0777
    )

with:

YARN/3.0.0.3.0/package/scripts/yarn.py

     params.HdfsResource(params.node_labels_dir,
                           type="directory",
                           action="create_on_execute",
 -                         change_permissions_for_parents=True,
                           owner=params.yarn_user,
                           group=params.user_group,
                           mode=0700
     )

Issue Links

• links to: Review request