[AMBARI-13251] RU - HDFS_Client restart and hdp-select causes dfs_data_dir_mount.hist to be lost, move file to static location

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.1.2
• Fix Version/s: 2.1.2
• Component/s: ambari-server
• Assignee: Alejandro Fernandez
• Reporter: Alejandro Fernandez
• Created: 26/Sep/15 20:57
• Updated: 28/Sep/15 21:38
• Resolved: 28/Sep/15 18:20

Description

During the Clients group of RU, restarting hdfs_client changes changes the symlink /usr/hdp/current/hadoop-client/ from the old version to the new version.

Because the Data Dir Mount History file is stored at /etc/hadoop/conf/dfs_data_dir_mount.hist and
/etc/hadoop/conf symlinks to /usr/hdp/current/hadoop-client/conf
it means that the file must be copied to the new location.

Multiple clients (HDFS, HBase, Hive, YARN, MapReduce, Pig, Slider, Tez) actually end up calling

hdp_select.select("hadoop-client", params.version)

that changes the symlink, so the first one to be ran during RU must copy the file. If DataNode is present, it means that HDFS Client is guaranteed to be there, and from all of those clients it is the first one in the Upgrade Pack.

During a Rolling Downgrade, the file should already exist in the previous version, and the file is only written to when DataNode is restarted, so we are ok.

Issue Links

• links to: Code Review patch