Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-13251

RU - HDFS_Client restart and hdp-select causes dfs_data_dir_mount.hist to be lost, move file to static location

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.1.2
    • Fix Version/s: 2.1.2
    • Component/s: ambari-server
    • Labels:
      None

      Description

      During the Clients group of RU, restarting hdfs_client changes changes the symlink /usr/hdp/current/hadoop-client/ from the old version to the new version.

      Because the Data Dir Mount History file is stored at /etc/hadoop/conf/dfs_data_dir_mount.hist and
      /etc/hadoop/conf symlinks to /usr/hdp/current/hadoop-client/conf
      it means that the file must be copied to the new location.

      Multiple clients (HDFS, HBase, Hive, YARN, MapReduce, Pig, Slider, Tez) actually end up calling

      hdp_select.select("hadoop-client", params.version)
      

      that changes the symlink, so the first one to be ran during RU must copy the file. If DataNode is present, it means that HDFS Client is guaranteed to be there, and from all of those clients it is the first one in the Upgrade Pack.

      During a Rolling Downgrade, the file should already exist in the previous version, and the file is only written to when DataNode is restarted, so we are ok.

        Attachments

        1. AMBARI-13251.patch
          240 kB
          Alejandro Fernandez

          Issue Links

            Activity

              People

              • Assignee:
                afernandez Alejandro Fernandez
                Reporter:
                afernandez Alejandro Fernandez
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: