[AMBARI-22011] Could not copy tez tarball to HDFS during prepare upgrade (EU)

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 2.6.0
• Component/s: ambari-server
• Assignee: Nate Cole
• Reporter: Nate Cole
• Created: 20/Sep/17 20:46
• Updated: 21/Sep/17 14:28
• Resolved: 21/Sep/17 12:54

Description

2017-09-19 11:42:05,103 - Task. Type: EXECUTE, Script: scripts/pre_upgrade.py - Function: prepare
2017-09-19 11:42:05,738 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
2017-09-19 11:42:05,739 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
2017-09-19 11:42:05,739 - An upgrade/downgrade for HDP-2.5.3.0-37 is in progress, determining which hadoop conf dir to use.
2017-09-19 11:42:05,740 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
2017-09-19 11:42:05,740 - Hadoop conf dir: /usr/hdp/2.5.3.0-37/hadoop/conf
2017-09-19 11:42:05,740 - Using hadoop conf dir: /usr/hdp/2.5.3.0-37/hadoop/conf
2017-09-19 11:42:05,742 - Before starting Stack Upgrade, check if tez tarball has been copied to HDFS.
2017-09-19 11:42:05,742 - Stack version 2.6.0.0 is sufficient to check if need to copy tez.tar.gz to HDFS.
2017-09-19 11:42:05,742 - Called copy_to_hdfs tarball: tez
2017-09-19 11:42:05,743 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=2.5.3.0-37, Upgrade Direction=upgrade -> 2.5.3.0-37
2017-09-19 11:42:05,743 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
2017-09-19 11:42:05,743 - Unable to determine the current version of the component for this command; unable to copy the tarball
2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 58, in <module>
    TezPreUpgrade().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 327, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 55, in prepare
    raise Fail("Could not copy tez tarball to HDFS.")
resource_management.core.exceptions.Fail: Could not copy tez tarball to HDFS.

Command failed after 1 tries

stderr:-

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/custom_actions/scripts/ru_execute_tasks.py", line 156, in <module>
    ExecuteUpgradeTasks().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 327, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/custom_actions/scripts/ru_execute_tasks.py", line 153, in actionexecute
    shell.checked_call(task.command, logoutput=True, quiet=True)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
    tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'source /var/lib/ambari-agent/ambari-env.sh ; /usr/bin/ambari-python-wrap /var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py prepare /var/lib/ambari-agent/data/command-380.json /var/lib/ambari-agent/cache/custom_actions /var/lib/ambari-agent/data/structured-out-380.json INFO /var/lib/ambari-agent/tmp' returned 1. 2017-09-19 11:42:05,738 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
2017-09-19 11:42:05,739 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
2017-09-19 11:42:05,739 - An upgrade/downgrade for HDP-2.5.3.0-37 is in progress, determining which hadoop conf dir to use.
2017-09-19 11:42:05,740 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
2017-09-19 11:42:05,740 - Hadoop conf dir: /usr/hdp/2.5.3.0-37/hadoop/conf
2017-09-19 11:42:05,740 - Using hadoop conf dir: /usr/hdp/2.5.3.0-37/hadoop/conf
2017-09-19 11:42:05,742 - Before starting Stack Upgrade, check if tez tarball has been copied to HDFS.
2017-09-19 11:42:05,742 - Stack version 2.6.0.0 is sufficient to check if need to copy tez.tar.gz to HDFS.
2017-09-19 11:42:05,742 - Called copy_to_hdfs tarball: tez
2017-09-19 11:42:05,743 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=2.5.3.0-37, Upgrade Direction=upgrade -> 2.5.3.0-37
2017-09-19 11:42:05,743 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
2017-09-19 11:42:05,743 - Unable to determine the current version of the component for this command; unable to copy the tarball
2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 58, in <module>
    TezPreUpgrade().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 327, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 55, in prepare
    raise Fail("Could not copy tez tarball to HDFS.")
resource_management.core.exceptions.Fail: Could not copy tez tarball to HDFS.

Issue Links

• links to: Review Board