[AMBARI-24281] Infra Solr migration: migrationConfigGenerator script failed with custom service user

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.0
• Fix Version/s: 2.7.1
• Component/s: ambari-infra
• Labels: pull-request-available
• Assignee: Oliver Szabo
• Reporter: Vivek Sharma
• Created: 11/Jul/18 18:28
• Updated: 20/Jul/18 09:23
• Resolved: 19/Jul/18 14:25

Description

if custom service user is used for ambari infra solr (config: infra-solr-env/infra_solr_user) the following error could happen

[root@ctr-e138-1518143905142-409212-01-000007 ~]# export CONFIG_INI_LOCATION=/hwqe/hadoopqe/artifacts/ambarieu-e2e-fnm30toatl-we-ha/config_ini/ambari_solr_migration.ini
[root@ctr-e138-1518143905142-409212-01-000007 ~]#
[root@ctr-e138-1518143905142-409212-01-000007 ~]# python /usr/lib/ambari-infra-solr-client/migrationConfigGenerator.py --ini-file $CONFIG_INI_LOCATION --host ctr-e138-1518143905142-409212-01-000006.hwx.site --port 8443 -s --cluster cl1 --username admin --password admin --backup-base-path=/tmp/ --java-home /usr/lib/jvm/java-openjdk
Start generating config file: /hwqe/hadoopqe/artifacts/ambarieu-e2e-fnm30toatl-we-ha/config_ini/ambari_solr_migration.ini ...
Get Ambari cluster details ...
Set JAVA_HOME: /usr/lib/jvm/java-openjdk
Service detected: ZOOKEEPER
Zookeeper connection string: ctr-e138-1518143905142-409212-01-000002.hwx.site:2181,ctr-e138-1518143905142-409212-01-000003.hwx.site:2181,ctr-e138-1518143905142-409212-01-000005.hwx.site:2181
Service detected: AMBARI_INFRA_SOLR
Infra Solr znode: /infra-solr
2018-07-11 18:06:16,822 - kinit: Keytab contains no suitable keys for cstm-infra-solr/[e-mail] while getting initial credentials

2018-07-11 18:06:16,824 - Get clusterstate.json: waiting for 5 seconds before retyring again (retry count: 1)
2018-07-11 18:06:21,850 - kinit: Keytab contains no suitable keys for cstm-infra-solr/[e-mail] while getting initial credentials

2018-07-11 18:06:21,851 - Get clusterstate.json: waiting for 5 seconds before retyring again (retry count: 2)
2018-07-11 18:06:26,875 - kinit: Keytab contains no suitable keys for cstm-infra-solr/[e-mail] while getting initial credentials

2018-07-11 18:06:26,876 - Get clusterstate.json: waiting for 5 seconds before retyring again (retry count: 3)
2018-07-11 18:06:31,901 - kinit: Keytab contains no suitable keys for cstm-infra-solr/[e-mail] while getting initial credentials

2018-07-11 18:06:31,902 - Get clusterstate.json: waiting for 5 seconds before retyring again (retry count: 4)
2018-07-11 18:06:36,931 - kinit: Keytab contains no suitable keys for cstm-infra-solr/[e-mail] while getting initial credentials

2018-07-11 18:06:36,932 - Get clusterstate.json: waiting for 5 seconds before retyring again (retry count: 5)
2018-07-11 18:06:41,959 - kinit: Keytab contains no suitable keys for cstm-infra-solr/[e-mail] while getting initial credentials

2018-07-11 18:06:41,959 - Get clusterstate.json: waiting for 5 seconds before retyring again (retry count: 6)
2018-07-11 18:06:46,996 - kinit: Keytab contains no suitable keys for cstm-infra-solr/[e-mail] while getting initial credentials

2018-07-11 18:06:46,997 - Get clusterstate.json: waiting for 5 seconds before retyring again (retry count: 7)
2018-07-11 18:06:52,040 - kinit: Keytab contains no suitable keys for cstm-infra-solr/[e-mail] while getting initial credentials

2018-07-11 18:06:52,040 - Get clusterstate.json: waiting for 5 seconds before retyring again (retry count: 8)
2018-07-11 18:06:57,075 - kinit: Keytab contains no suitable keys for cstm-infra-solr/[e-mail] while getting initial credentials

2018-07-11 18:06:57,076 - Get clusterstate.json: waiting for 5 seconds before retyring again (retry count: 9)
2018-07-11 18:07:02,098 - kinit: Keytab contains no suitable keys for cstm-infra-solr/[e-mail] while getting initial credentials

2018-07-11 18:07:02,098 - Get clusterstate.json: waiting for 5 seconds before retyring again (retry count: 10)
Traceback (most recent call last):
  File "/usr/lib/ambari-infra-solr-client/migrationConfigGenerator.py", line 507, in <module>
    generate_ambari_solr_migration_ini_file(options, accessor, protocol)
  File "/usr/lib/ambari-infra-solr-client/migrationConfigGenerator.py", line 343, in generate_ambari_solr_migration_ini_file
    coll_shard_map=get_shard_numbers_per_collections(state_json_map)
  File "/usr/lib/ambari-infra-solr-client/migrationConfigGenerator.py", line 124, in get_shard_numbers_per_collections
    for key,val in state_json_data.iteritems():
AttributeError: 'NoneType' object has no attribute 'iteritems'

Config file generation failed

Issue Links

• links to: GitHub Pull Request #1749
• links to: GitHub Pull Request #1752