Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-10500

Error installing ambari-metrics-assembly during cluster setup wizard

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • 2.0.0
    • None
    • ambari-metrics

    • Ubuntu 12.04 fresh installation on ProfitBricks.

    Description

      I have a small cluster on Profitbricks. It consists of 4 machines:
      the ambari server

      • a node running the name node, s name node, history server, app timeline server, hbase master, zookeeper server
      • a node running resource manager, metrics collector, zookeeper server
      • a node running a data node, client and the zookeeper server

      On step 9 of the installation wizard, the 1st and 3rd nodes finish installing with warnings, while the second fails with the following output:

      stderr: /var/lib/ambari-agent/data/errors-113.txt

      2015-04-15 12:37:28,467 - Error while executing command 'install':
      Traceback (most recent call last):
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 214, in execute
      method(env)
      File "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/metrics_monitor.py", line 28, in install
      self.install_packages(env, exclude_packages = ['ambari-metrics-collector'])
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 289, in install_packages
      Package(name)
      File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in _init_
      self.env.run()
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
      self.run_action(resource, action)
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
      provider_action()
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/_init_.py", line 43, in action_install
      self.install_package(package_name, self.resource.use_repos)
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/apt.py", line 55, in wrapper
      return function_to_decorate(self, name, *args[2:])
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/apt.py", line 95, in install_package
      shell.checked_call(cmd, sudo=True, logoutput=self.get_logoutput())
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
      return function(command, **kwargs)
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 82, in checked_call
      return _call(command, logoutput, True, cwd, env, preexec_fn, user, wait_for_finish, timeout, path, sudo, on_new_line)
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 199, in _call
      raise Fail(err_msg)
      Fail: Execution of '/usr/bin/apt-get q -o Dpkg::Options::=-force-confdef --allow-unauthenticated --assume-yes install ambari-metrics-assembly' returned 100. Reading package lists...
      Building dependency tree...
      Reading state information...
      E: Unable to locate package ambari-metrics-assembly

      stdout: /var/lib/ambari-agent/data/output-113.txt

      2015-04-15 12:37:13,647 - u"Directory['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/']"

      Unknown macro: {'recursive'}

      2015-04-15 12:37:13,828 - u"File['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip']"

      Unknown macro: {'content'}

      2015-04-15 12:37:13,924 - Not downloading the file from http://10.0.10.13:8080/resources//UnlimitedJCEPolicyJDK7.zip, because /var/lib/ambari-agent/data/tmp/UnlimitedJCEPolicyJDK7.zip already exists
      2015-04-15 12:37:14,106 - u"Group['hadoop']"

      Unknown macro: {'ignore_failures'}

      2015-04-15 12:37:14,107 - Modifying group hadoop
      2015-04-15 12:37:14,160 - u"Group['users']"

      Unknown macro: {'ignore_failures'}

      2015-04-15 12:37:14,161 - Modifying group users
      2015-04-15 12:37:14,211 - u"User['mapred']"

      Unknown macro: {'gid'}

      2015-04-15 12:37:14,212 - Modifying user mapred
      2015-04-15 12:37:14,264 - u"User['hbase']"

      Unknown macro: {'gid'}

      2015-04-15 12:37:14,264 - Modifying user hbase
      2015-04-15 12:37:14,316 - u"User['ambari-qa']"

      Unknown macro: {'gid'}

      2015-04-15 12:37:14,317 - Modifying user ambari-qa
      2015-04-15 12:37:14,368 - u"User['zookeeper']"

      Unknown macro: {'gid'}

      2015-04-15 12:37:14,368 - Modifying user zookeeper
      2015-04-15 12:37:14,420 - u"User['hdfs']"

      Unknown macro: {'gid'}

      2015-04-15 12:37:14,421 - Modifying user hdfs
      2015-04-15 12:37:14,472 - u"User['yarn']"

      Unknown macro: {'gid'}

      2015-04-15 12:37:14,473 - Modifying user yarn
      2015-04-15 12:37:14,524 - u"User['ams']"

      Unknown macro: {'gid'}

      2015-04-15 12:37:14,525 - Modifying user ams
      2015-04-15 12:37:14,577 - u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']"

      Unknown macro: {'content'}

      2015-04-15 12:37:14,901 - u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']"

      Unknown macro: {'not_if'}

      2015-04-15 12:37:14,949 - Skipping u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']" due to not_if
      2015-04-15 12:37:14,950 - u"Directory['/hadoop/hbase']"

      Unknown macro: {'owner'}

      2015-04-15 12:37:15,323 - u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']"

      Unknown macro: {'content'}

      2015-04-15 12:37:15,648 - u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase']"

      Unknown macro: {'not_if'}

      2015-04-15 12:37:15,697 - Skipping u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase']" due to not_if
      2015-04-15 12:37:15,698 - u"Group['hdfs']"

      Unknown macro: {'ignore_failures'}

      2015-04-15 12:37:15,699 - Modifying group hdfs
      2015-04-15 12:37:15,748 - u"User['hdfs']"

      Unknown macro: {'ignore_failures'}

      2015-04-15 12:37:15,748 - Modifying user hdfs
      2015-04-15 12:37:15,800 - u"Directory['/etc/hadoop']"

      Unknown macro: {'mode'}

      2015-04-15 12:37:15,979 - u"Directory['/etc/hadoop/conf.empty']"

      Unknown macro: {'owner'}

      2015-04-15 12:37:16,151 - u"Link['/etc/hadoop/conf']"

      Unknown macro: {'not_if'}

      2015-04-15 12:37:16,205 - Skipping u"Link['/etc/hadoop/conf']" due to not_if
      2015-04-15 12:37:16,233 - u"File['/etc/hadoop/conf/hadoop-env.sh']"

      Unknown macro: {'content'}

      2015-04-15 12:37:16,530 - u"Repository['HDP-2.2']"

      Unknown macro: {'base_url'}

      2015-04-15 12:37:16,544 - u"File['/tmp/tmpgBi5pn']"

      Unknown macro: {'content'}

      2015-04-15 12:37:16,784 - Writing u"File['/tmp/tmpgBi5pn']" because contents don't match
      2015-04-15 12:37:16,957 - u"Repository['HDP-UTILS-1.1.0.20']"

      Unknown macro: {'base_url'}

      2015-04-15 12:37:16,962 - u"File['/tmp/tmpsGGmUP']"

      Unknown macro: {'content'}

      2015-04-15 12:37:17,160 - Writing u"File['/tmp/tmpsGGmUP']" because contents don't match
      2015-04-15 12:37:17,340 - u"Package['unzip']" {}
      2015-04-15 12:37:17,429 - Skipping installing existent package unzip
      2015-04-15 12:37:17,430 - u"Package['curl']" {}
      2015-04-15 12:37:17,518 - Skipping installing existent package curl
      2015-04-15 12:37:17,519 - u"Package['hdp-select']" {}
      2015-04-15 12:37:17,607 - Skipping installing existent package hdp-select
      2015-04-15 12:37:17,609 - u"Directory['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/']"

      Unknown macro: {'recursive'}

      2015-04-15 12:37:17,788 - u"File['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz']"

      Unknown macro: {'content'}

      2015-04-15 12:37:17,887 - Not downloading the file from http://10.0.10.13:8080/resources//jdk-7u67-linux-x64.tar.gz, because /var/lib/ambari-agent/data/tmp/jdk-7u67-linux-x64.tar.gz already exists
      2015-04-15 12:37:19,267 - u"Directory['/usr/jdk64']" {}
      2015-04-15 12:37:19,437 - u"Execute['('chmod', 'a+x', u'/usr/jdk64')']"

      Unknown macro: {'not_if'}

      2015-04-15 12:37:19,485 - Skipping u"Execute['('chmod', 'a+x', u'/usr/jdk64')']" due to not_if
      2015-04-15 12:37:19,486 - u"Execute['mkdir -p /var/lib/ambari-agent/data/tmp/jdk && cd /var/lib/ambari-agent/data/tmp/jdk && tar -xf /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz && ambari-sudo.sh cp -rp /var/lib/ambari-agent/data/tmp/jdk/* /usr/jdk64']"

      Unknown macro: {'not_if'}

      2015-04-15 12:37:19,535 - Skipping u"Execute['mkdir -p /var/lib/ambari-agent/data/tmp/jdk && cd /var/lib/ambari-agent/data/tmp/jdk && tar -xf /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz && ambari-sudo.sh cp -rp /var/lib/ambari-agent/data/tmp/jdk/* /usr/jdk64']" due to not_if
      2015-04-15 12:37:19,536 - u"Execute['('chgrp', '-R', u'hadoop', u'/usr/jdk64/jdk1.7.0_67')']"

      Unknown macro: {'sudo'}

      2015-04-15 12:37:19,626 - u"Execute['('chown', '-R', 'root', u'/usr/jdk64/jdk1.7.0_67')']"

      Unknown macro: {'sudo'}

      2015-04-15 12:37:19,991 - u"Package['ambari-metrics-assembly']" {}
      2015-04-15 12:37:20,075 - Installing package ambari-metrics-assembly ('/usr/bin/apt-get q -o Dpkg::Options::=-force-confdef --allow-unauthenticated --assume-yes install ambari-metrics-assembly')
      2015-04-15 12:37:20,732 - Execution of '['/usr/bin/apt-get', '-q', '-o', 'Dpkg::Options::=--force-confdef', '--allow-unauthenticated', '--assume-yes', 'install', u'ambari-metrics-assembly']' returned 100. Reading package lists...
      Building dependency tree...
      Reading state information...
      E: Unable to locate package ambari-metrics-assembly
      2015-04-15 12:37:20,732 - Failed to install package ambari-metrics-assembly. Executing `/usr/bin/apt-get update -qq`
      2015-04-15 12:37:27,811 - Retrying to install package ambari-metrics-assembly
      2015-04-15 12:37:28,467 - Error while executing command 'install':
      Traceback (most recent call last):
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 214, in execute
      method(env)
      File "/var/lib/ambari-agent/cache/common-services/AMBARI_METRICS/0.1.0/package/scripts/metrics_monitor.py", line 28, in install
      self.install_packages(env, exclude_packages = ['ambari-metrics-collector'])
      File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 289, in install_packages
      Package(name)
      File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in _init_
      self.env.run()
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
      self.run_action(resource, action)
      File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
      provider_action()
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/_init_.py", line 43, in action_install
      self.install_package(package_name, self.resource.use_repos)
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/apt.py", line 55, in wrapper
      return function_to_decorate(self, name, *args[2:])
      File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/apt.py", line 95, in install_package
      shell.checked_call(cmd, sudo=True, logoutput=self.get_logoutput())
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
      return function(command, **kwargs)
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 82, in checked_call
      return _call(command, logoutput, True, cwd, env, preexec_fn, user, wait_for_finish, timeout, path, sudo, on_new_line)
      File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 199, in _call
      raise Fail(err_msg)
      Fail: Execution of '/usr/bin/apt-get q -o Dpkg::Options::=-force-confdef --allow-unauthenticated --assume-yes install ambari-metrics-assembly' returned 100. Reading package lists...
      Building dependency tree...
      Reading state information...
      E: Unable to locate package ambari-metrics-assembly

      Attachments

        Activity

          People

            Unassigned Unassigned
            zoltanmaric Zoltán Marić
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: