[AMBARI-9939] RU - Service Check group to include all services with a service_check script

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Component/s: ambari-server
• Labels: rolling_upgrade
• Assignee: Alejandro Fernandez
• Reporter: Alejandro Fernandez
• Created: 05/Mar/15 01:55
• Updated: 06/Mar/15 01:12
• Resolved: 05/Mar/15 22:42

Description

Installed a minimal 3-node cluster with HDFS, MR, YARN, Pig, Tez.
Performed an RU.

Expected result is for the last service check to be ran on all components. However, it skipped Pig Service Check.

http://c6401.ambari.apache.org:8080/api/v1/clusters/c1/upgrades/32/upgrade_groups/8

{
  "href" : "http://c6401.ambari.apache.org:8080/api/v1/clusters/c1/upgrades/32/upgrade_groups/8",
  "UpgradeGroup" : {
    "completed_task_count" : 4,
    "group_id" : 8,
    "in_progress_task_count" : 0,
    "name" : "SERVICE_CHECK",
    "progress_percent" : 100.0,
    "request_id" : 32,
    "status" : "COMPLETED",
    "title" : "All Service Checks",
    "total_task_count" : 4
  },
  "upgrade_items" : [
    {
      "href" : "http://c6401.ambari.apache.org:8080/api/v1/clusters/c1/upgrades/32/upgrade_groups/8/upgrade_items/47",
      "UpgradeItem" : {
        "cluster_name" : "c1",
        "group_id" : 8,
        "request_id" : 32,
        "stage_id" : 47
      }
    },
    {
      "href" : "http://c6401.ambari.apache.org:8080/api/v1/clusters/c1/upgrades/32/upgrade_groups/8/upgrade_items/48",
      "UpgradeItem" : {
        "cluster_name" : "c1",
        "group_id" : 8,
        "request_id" : 32,
        "stage_id" : 48
      }
    },
    {
      "href" : "http://c6401.ambari.apache.org:8080/api/v1/clusters/c1/upgrades/32/upgrade_groups/8/upgrade_items/49",
      "UpgradeItem" : {
        "cluster_name" : "c1",
        "group_id" : 8,
        "request_id" : 32,
        "stage_id" : 49
      }
    },
    {
      "href" : "http://c6401.ambari.apache.org:8080/api/v1/clusters/c1/upgrades/32/upgrade_groups/8/upgrade_items/50",
      "UpgradeItem" : {
        "cluster_name" : "c1",
        "group_id" : 8,
        "request_id" : 32,
        "stage_id" : 50
      }
    }
  ]
}

http://c6401.ambari.apache.org:8080/api/v1/clusters/c1/upgrades/32/upgrade_groups/8/upgrade_items?fields=UpgradeItem/text

{
  "href" : "http://c6401.ambari.apache.org:8080/api/v1/clusters/c1/upgrades/32/upgrade_groups/8/upgrade_items?fields=UpgradeItem/text",
  "items" : [
    {
      "href" : "http://c6401.ambari.apache.org:8080/api/v1/clusters/c1/upgrades/32/upgrade_groups/8/upgrade_items/47",
      "UpgradeItem" : {
        "cluster_name" : "c1",
        "group_id" : 8,
        "request_id" : 32,
        "stage_id" : 47,
        "text" : "Service Check HDFS"
      }
    },
    {
      "href" : "http://c6401.ambari.apache.org:8080/api/v1/clusters/c1/upgrades/32/upgrade_groups/8/upgrade_items/48",
      "UpgradeItem" : {
        "cluster_name" : "c1",
        "group_id" : 8,
        "request_id" : 32,
        "stage_id" : 48,
        "text" : "Service Check YARN"
      }
    },
    {
      "href" : "http://c6401.ambari.apache.org:8080/api/v1/clusters/c1/upgrades/32/upgrade_groups/8/upgrade_items/49",
      "UpgradeItem" : {
        "cluster_name" : "c1",
        "group_id" : 8,
        "request_id" : 32,
        "stage_id" : 49,
        "text" : "Service Check ZooKeeper"
      }
    },
    {
      "href" : "http://c6401.ambari.apache.org:8080/api/v1/clusters/c1/upgrades/32/upgrade_groups/8/upgrade_items/50",
      "UpgradeItem" : {
        "cluster_name" : "c1",
        "group_id" : 8,
        "request_id" : 32,
        "stage_id" : 50,
        "text" : "Service Check MapReduce2"
      }
    }
  ]
}

The Upgrade Pack contains,

    <group name="SERVICE_CHECK" title="All Service Checks" xsi:type="service-check">
      <skippable>true</skippable>
      <direction>UPGRADE</direction>
      <priority>
        <service>HDFS</service>
        <service>YARN</service>
        <service>HBASE</service>
      </priority>
    </group>

Because the pig service check was not ran, the new tez tarball was not copied to HDFS.
The underlying issue is that a service is not added to the Service Check group if it is a clientOnly service. However, Pig is clientOnly but still have a service check python script.

Issue Links

• links to: Code Review patch