Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-12581

Host check/clean-up logic should clean up new packages and folder names

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.1.2
    • Component/s: None
    • Labels:
      None

      Description

      Few HDP-2.3 installation ran into problem when install performed on VMs that are not clean. One of the reported problem is:

      Traceback (most recent call last):
        File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py", line 38, in <module>
          AfterInstallHook().execute()
        File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 218, in execute
          method(env)
        File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/hook.py", line 35, in hook
          link_configs(self.stroutfile)
        File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py", line 91, in link_configs
          _link_configs(k, json_version, v)
        File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/after-INSTALL/scripts/shared_initialization.py", line 156, in _link_configs
          conf_select.select("HDP", package, version)
        File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/conf_select.py", line 241, in select
          shell.checked_call(get_cmd("set-conf-dir", package, version), logoutput=False, quiet=False, sudo=True)
        File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
          result = function(command, **kwargs)
        File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
          tries=tries, try_sleep=try_sleep)
        File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
          result = _call(command, **kwargs_copy)
        File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call
          raise Fail(err_msg)
      resource_management.core.exceptions.Fail: Execution of 'conf-select set-conf-dir --package ranger-kms --stack-version 2.3.0.0-2557 --conf-version 0' returned 1. ranger-kms not installed or incorrect package name
      

      AMBARI-12515 is looking into making conf-select call more robust but host-clean up script (along with host checkup) need to be modified to handle the new folders introduced under "/etc" as well as "/usr/hdp/current" or "/usr/hdp/version".

      Suggestion from Nate Cole regarding cleaning up conf dirs.

      cd /etc
      remove accumulo ambari-* atlas hadoop-* hive* hive-* mahout phoenix ranger spark zookeeper falcon hadoop hbase kafka knox oozie ranger-* (ranger-admin, ranger-kms, ranger-usersync) slider sqoop storm pig flume hive-hcatalog
      

      The host check script should be modified to include these folders in the report so that the cleanup script can clean it.

        Attachments

        1. AMBARI-12581.patch
          3 kB
          Dmitry Lysnichenko
        2. AMBARI-12581.2.patch
          4 kB
          Dmitry Lysnichenko
        3. AMBARI-12581.branch2.1.2.patch
          4 kB
          Dmitry Lysnichenko

          Activity

            People

            • Assignee:
              dmitriusan Dmitry Lysnichenko
              Reporter:
              dmitriusan Dmitry Lysnichenko
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: