Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-21504

Restart of MR2 History Server failed due to null in immutable_paths

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.5.2
    • Fix Version/s: 2.5.2
    • Component/s: ambari-server
    • Labels:
      None

      Description

      Steps:

      • Installed Ambari 2.2 with Slider and services it required
      • Upgraded Ambari to 2.5.2.0-134
      • Registered HDP 2.6.1.0 repo, installed packages
      • Restarted services that needed restart
      • Ran service checks
      • Started upgrade

      Result: Restarting History Server step failed with

      errors-91.txt
      Traceback (most recent call last):
        File "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py", line 134, in <module>
          HistoryServer().execute()
        File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 329, in execute
          method(env)
        File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 841, in restart
          self.pre_upgrade_restart(env, upgrade_type=upgrade_type)
        File "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py", line 85, in pre_upgrade_restart
          copy_to_hdfs("mapreduce", params.user_group, params.hdfs_user, skip=params.sysprep_skip_copy_tarballs_hdfs)
        File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/copy_tarball.py", line 256, in copy_to_hdfs
          mode=0555
        File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
          self.env.run()
        File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
          self.run_action(resource, action)
        File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
          provider_action()
        File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 560, in action_create_on_execute
          self.action_delayed("create")
        File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 550, in action_delayed
          parsed_not_managed_paths = [HdfsResourceProvider.parse_path(path) for path in self.resource.immutable_paths]
        File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 519, in parse_path
          math_with_protocol_and_nn_url = re.match("[a-zA-Z]+://[^/]+(/.+)", path)
        File "/usr/lib64/python2.7/re.py", line 137, in match
          return _compile(pattern, flags).match(string)
      TypeError: expected string or buffer
      
      command-91.json
      "hostLevelParams": {
      ...
      "not_managed_hdfs_path_list": "[null,\"/mr-history/done\",\"/app-logs\"]",
      ...
      }
      

      Failure seems to be due to null value in the list.

      1. AMBARI-21504.patch
        12 kB
        Vitaly Brodetskyi

        Issue Links

          Activity

          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12877662/AMBARI-21504.patch
          against trunk revision .

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/Ambari-trunk-test-patch/11804//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12877662/AMBARI-21504.patch against trunk revision . -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/Ambari-trunk-test-patch/11804//console This message is automatically generated.
          Hide
          vbrodetskyi Vitaly Brodetskyi added a comment -

          Committed to trunk and branch-2.5

          Show
          vbrodetskyi Vitaly Brodetskyi added a comment - Committed to trunk and branch-2.5

            People

            • Assignee:
              vbrodetskyi Vitaly Brodetskyi
              Reporter:
              vbrodetskyi Vitaly Brodetskyi
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development