[ASTERIXDB-1510] WARNING!:Node Controller not running at the following nodes

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Component/s: *DB - AsterixDB, CONF - Configuration
• Environment: Docker kevincoakley/asterixdb
• Assignee: Ian Maxon
• Reporter: Aidan Macdonald
• Created: 30/Jun/16 00:29
• Updated: 12/Jan/18 22:19
• Resolved: 12/Jan/18 22:19

Description

I get the following error

$ docker exec master /opt/asterixdb/bin/managix describe -n cluster -admin
INFO: Name:cluster
Created:Thu Jun 30 00:11:03 UTC 2016
Web-Url:http://172.17.1.198:19001
State:ACTIVE

WARNING!:Node Controller not running at the following nodes
172.17.1.200
172.17.1.202

Master node:master:172.17.1.198
slave0:172.17.1.199
slave1:172.17.1.200
slave2:172.17.1.201
slave3:172.17.1.202
slave4:172.17.1.203
slave5:172.17.1.204
slave6:172.17.1.205
slave7:172.17.1.206

I am using the following configuration

$ cat clusters/cluster.xml
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<cluster xmlns="cluster">
    <java_home>/usr/lib/jvm/java-7-openjdk-amd64/jre</java_home>
    <log_dir>/opt/asterixdb/clusters/local/working_dir/logs</log_dir>
    <txn_log_dir>/opt/asterixdb/clusters/local/working_dir/txnLogs</txn_log_dir>
    <store>storage</store>
    <iodevices>/opt/asterixdb/clusters/local/working_dir</iodevices>
    <working_dir>
        <dir>/opt/asterixdb/clusters/local/working_dir</dir>
        <NFS>true</NFS>
    </working_dir>

    <master_node>
        <id>master</id>
        <client_ip>172.17.1.198</client_ip>
        <cluster_ip>172.17.1.198</cluster_ip>
        <client_port>1098</client_port>
        <cluster_port>1099</cluster_port>
        <http_port>8888</http_port>
    </master_node>

    <node><id>slave0</id><cluster_ip>172.17.1.199</cluster_ip></node>
    <node><id>slave1</id><cluster_ip>172.17.1.200</cluster_ip></node>
    <node><id>slave2</id><cluster_ip>172.17.1.201</cluster_ip></node>
    <node><id>slave3</id><cluster_ip>172.17.1.202</cluster_ip></node>
    <node><id>slave4</id><cluster_ip>172.17.1.203</cluster_ip></node>
    <node><id>slave5</id><cluster_ip>172.17.1.204</cluster_ip></node>
    <node><id>slave6</id><cluster_ip>172.17.1.205</cluster_ip></node>
    <node><id>slave7</id><cluster_ip>172.17.1.206</cluster_ip></node>
</cluster>

None of my launch scripts give any errors. Everything looks fine at launch, except that after, a couple nodes die which breaks the web interface.