Uploaded image for project: 'CouchDB'
  1. CouchDB
  2. COUCHDB-3050

sometimes couchdb build from master returns 503 and does not boot up

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.0.0
    • Fix Version/s: None
    • Component/s: Database Core
    • Labels:
      None

      Description

      sometimes a couchdb build from master with haproxy returns a 503 and does not boot up.

      example: https://travis-ci.org/apache/couchdb-fauxton/builds/141268935#L5878

        Activity

        Hide
        garren Garren Smith added a comment -

        Had this happen a few times today https://travis-ci.org/apache/couchdb-fauxton/builds/142451346

        [ * ] Setup environment ... ok
        [ * ] Ensure CouchDB is built ... ok
        [ * ] Prepare configuration files ... ok
        [ * ] Start node node1 ... ok
        [ * ] Start node node2 ... ok
        [ * ] Start node node3 ... ok
        [ * ] Check node at http://127.0.0.1:15984/ ... failed: [Errno socket error] [Errno 111] Connection refused
        [ * ] Check node at http://127.0.0.1:25984/ ... failed: [Errno socket error] [Errno 111] Connection refused
        [ * ] Check node at http://127.0.0.1:35984/ ... failed: [Errno socket error] [Errno 111] Connection refused
        [ * ] Check node at http://127.0.0.1:15984/ ... ok
        [ * ] Check node at http://127.0.0.1:25984/ ... ok
        [ * ] Check node at http://127.0.0.1:35984/ ... ok
        [ * ] Running cluster setup ... failed: [Errno 111] Connection refused
        Traceback (most recent call last):
          File "/usr/src/couchdb/dev/run", line 534, in <module>
            main()
          File "/usr/src/couchdb/dev/run", line 81, in main
            startup(ctx)
          File "/usr/src/couchdb/dev/run", line 308, in startup
            cluster_setup(ctx)
          File "/usr/src/couchdb/dev/run", line 65, in wrapper
            res = func(*args, **kwargs)
          File "/usr/src/couchdb/dev/run", line 396, in cluster_setup
            add_node(lead_port, node_port, *ctx['admin'])
          File "/usr/src/couchdb/dev/run", line 428, in add_node
            'Content-Type': 'application/json'})
          File "/usr/lib/python2.7/httplib.py", line 1001, in request
            self._send_request(method, url, body, headers)
          File "/usr/lib/python2.7/httplib.py", line 1035, in _send_request
            self.endheaders(body)
          File "/usr/lib/python2.7/httplib.py", line 997, in endheaders
            self._send_output(message_body)
          File "/usr/lib/python2.7/httplib.py", line 850, in _send_output
            self.send(msg)
          File "/usr/lib/python2.7/httplib.py", line 812, in send
            self.connect()
          File "/usr/lib/python2.7/httplib.py", line 793, in connect
            self.timeout, self.source_address)
          File "/usr/lib/python2.7/socket.py", line 571, in create_connection
            raise err
        socket.error: [Errno 111] Connection refused
        
        Show
        garren Garren Smith added a comment - Had this happen a few times today https://travis-ci.org/apache/couchdb-fauxton/builds/142451346 [ * ] Setup environment ... ok [ * ] Ensure CouchDB is built ... ok [ * ] Prepare configuration files ... ok [ * ] Start node node1 ... ok [ * ] Start node node2 ... ok [ * ] Start node node3 ... ok [ * ] Check node at http: //127.0.0.1:15984/ ... failed: [Errno socket error] [Errno 111] Connection refused [ * ] Check node at http: //127.0.0.1:25984/ ... failed: [Errno socket error] [Errno 111] Connection refused [ * ] Check node at http: //127.0.0.1:35984/ ... failed: [Errno socket error] [Errno 111] Connection refused [ * ] Check node at http: //127.0.0.1:15984/ ... ok [ * ] Check node at http: //127.0.0.1:25984/ ... ok [ * ] Check node at http: //127.0.0.1:35984/ ... ok [ * ] Running cluster setup ... failed: [Errno 111] Connection refused Traceback (most recent call last): File "/usr/src/couchdb/dev/run" , line 534, in <module> main() File "/usr/src/couchdb/dev/run" , line 81, in main startup(ctx) File "/usr/src/couchdb/dev/run" , line 308, in startup cluster_setup(ctx) File "/usr/src/couchdb/dev/run" , line 65, in wrapper res = func(*args, **kwargs) File "/usr/src/couchdb/dev/run" , line 396, in cluster_setup add_node(lead_port, node_port, *ctx['admin']) File "/usr/src/couchdb/dev/run" , line 428, in add_node 'Content-Type': 'application/json'}) File "/usr/lib/python2.7/httplib.py" , line 1001, in request self._send_request(method, url, body, headers) File "/usr/lib/python2.7/httplib.py" , line 1035, in _send_request self.endheaders(body) File "/usr/lib/python2.7/httplib.py" , line 997, in endheaders self._send_output(message_body) File "/usr/lib/python2.7/httplib.py" , line 850, in _send_output self.send(msg) File "/usr/lib/python2.7/httplib.py" , line 812, in send self.connect() File "/usr/lib/python2.7/httplib.py" , line 793, in connect self.timeout, self.source_address) File "/usr/lib/python2.7/socket.py" , line 571, in create_connection raise err socket.error: [Errno 111] Connection refused
        Hide
        robertkowalski Robert Kowalski added a comment -

        still happens:

        ```
        Error in nano populateDatabase Function: in database: fauxton-selenium-tests-2467 couch returned 500
        Error in nano populateDatabase Function: couch returned 500
        ```

        Show
        robertkowalski Robert Kowalski added a comment - still happens: ``` Error in nano populateDatabase Function: in database: fauxton-selenium-tests-2467 couch returned 500 Error in nano populateDatabase Function: couch returned 500 ```
        Hide
        robertkowalski Robert Kowalski added a comment -

        looks like a race which affects the /dev/run bootstrapping script for development. so no blocker.

        Show
        robertkowalski Robert Kowalski added a comment - looks like a race which affects the /dev/run bootstrapping script for development. so no blocker.
        Hide
        robertkowalski Robert Kowalski added a comment -

        also applies to the docker image we use now:

        [ * ] Setup environment ... ok
        [ * ] Ensure CouchDB is built ... ok
        [ * ] Prepare configuration files ... ok
        [ * ] Start node node1 ... ok
        [ * ] Start node node2 ... ok
        [ * ] Start node node3 ... ok
        [ * ] Check node at http://127.0.0.1:15984/ ... failed: [Errno socket error] [Errno 111] Connection refused
        [ * ] Check node at http://127.0.0.1:25984/ ... failed: [Errno socket error] [Errno 111] Connection refused
        [ * ] Check node at http://127.0.0.1:35984/ ... ok
        [ * ] Check node at http://127.0.0.1:15984/ ... ok
        [ * ] Check node at http://127.0.0.1:25984/ ... ok
        [ * ] Running cluster setup ... failed: [Errno 111] Connection refused
        Traceback (most recent call last):
        File "/usr/src/couchdb/dev/run", line 535, in <module>
        main()
        File "/usr/src/couchdb/dev/run", line 81, in main
        startup(ctx)
        File "/usr/src/couchdb/dev/run", line 308, in startup
        cluster_setup(ctx)
        File "/usr/src/couchdb/dev/run", line 65, in wrapper
        res = func(*args, **kwargs)
        File "/usr/src/couchdb/dev/run", line 397, in cluster_setup
        add_node(lead_port, node_port, *ctx['admin'])
        File "/usr/src/couchdb/dev/run", line 429, in add_node
        'Content-Type': 'application/json'})
        File "/usr/lib/python2.7/httplib.py", line 1001, in request
        self._send_request(method, url, body, headers)
        File "/usr/lib/python2.7/httplib.py", line 1035, in _send_request
        self.endheaders(body)
        File "/usr/lib/python2.7/httplib.py", line 997, in endheaders
        self._send_output(message_body)
        File "/usr/lib/python2.7/httplib.py", line 850, in _send_output
        self.send(msg)
        File "/usr/lib/python2.7/httplib.py", line 812, in send
        self.connect()
        File "/usr/lib/python2.7/httplib.py", line 793, in connect
        self.timeout, self.source_address)
        File "/usr/lib/python2.7/socket.py", line 571, in create_connection
        raise err
        socket.error: [Errno 111] Connection refused

        Show
        robertkowalski Robert Kowalski added a comment - also applies to the docker image we use now: [ * ] Setup environment ... ok [ * ] Ensure CouchDB is built ... ok [ * ] Prepare configuration files ... ok [ * ] Start node node1 ... ok [ * ] Start node node2 ... ok [ * ] Start node node3 ... ok [ * ] Check node at http://127.0.0.1:15984/ ... failed: [Errno socket error] [Errno 111] Connection refused [ * ] Check node at http://127.0.0.1:25984/ ... failed: [Errno socket error] [Errno 111] Connection refused [ * ] Check node at http://127.0.0.1:35984/ ... ok [ * ] Check node at http://127.0.0.1:15984/ ... ok [ * ] Check node at http://127.0.0.1:25984/ ... ok [ * ] Running cluster setup ... failed: [Errno 111] Connection refused Traceback (most recent call last): File "/usr/src/couchdb/dev/run", line 535, in <module> main() File "/usr/src/couchdb/dev/run", line 81, in main startup(ctx) File "/usr/src/couchdb/dev/run", line 308, in startup cluster_setup(ctx) File "/usr/src/couchdb/dev/run", line 65, in wrapper res = func(*args, **kwargs) File "/usr/src/couchdb/dev/run", line 397, in cluster_setup add_node(lead_port, node_port, *ctx ['admin'] ) File "/usr/src/couchdb/dev/run", line 429, in add_node 'Content-Type': 'application/json'}) File "/usr/lib/python2.7/httplib.py", line 1001, in request self._send_request(method, url, body, headers) File "/usr/lib/python2.7/httplib.py", line 1035, in _send_request self.endheaders(body) File "/usr/lib/python2.7/httplib.py", line 997, in endheaders self._send_output(message_body) File "/usr/lib/python2.7/httplib.py", line 850, in _send_output self.send(msg) File "/usr/lib/python2.7/httplib.py", line 812, in send self.connect() File "/usr/lib/python2.7/httplib.py", line 793, in connect self.timeout, self.source_address) File "/usr/lib/python2.7/socket.py", line 571, in create_connection raise err socket.error: [Errno 111] Connection refused

          People

          • Assignee:
            Unassigned
            Reporter:
            robertkowalski Robert Kowalski
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:

              Development