Uploaded image for project: 'CouchDB'
  1. CouchDB
  2. COUCHDB-2061

Problem with indexing npmjs reposioty - replication.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 1.4.0, 1.5.0
    • None
    • Replication
    • None

    Description

      When I start the replication npmjs from http://isaacs.iriscouch.com/registry/ I don't have any packages shown in gui. In the log i see message:

      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.169.0>] Opening index for db: registry idx: _design/ui sig: "d219c0be7f48a555a4ad0137e9b2b600"
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.188.0>] Starting index update for db: registry idx: _design/ui
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.166.0>] 10.214.8.13 - - GET /registry/_all_docs?limit=0 200
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.138.0>] 10.214.8.28 - - GET /registry/_design/ui/images/logo.png 200
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id tilemap
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id illumina2bam-tools
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id kick
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id redis2json
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id touchit
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id node-request-caching
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id score
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id frst
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id caboose-redis
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id convoy-less
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id up-hook
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id connect-recaptcha
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id locksmith
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id sorta
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id wreq
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id upnode
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id waiting-around
      [Wed, 12 Feb 2014 09:55:04 GMT] [info] [<0.195.0>] OS Process #Port<0.3541> Log :: function raised exception (new TypeError("doc.versions[doc['dist-tags'].latest].tags is undefined", "undefined", 3)) with doc._id ncm
      
      (...)
      
      [Wed, 12 Feb 2014 09:55:59 GMT] [error] [<0.193.0>] OS Process Error <0.195.0> :: {os_process_error,
                                                         "OS process timed out."}
      [Wed, 12 Feb 2014 09:55:59 GMT] [error] [emulator] Error in process <0.193.0> with exit value: {{nocatch,{os_process_error,"OS process timed out."}},[{couch_os_process,prompt,2},{couch_query_servers,map_doc_raw,2},{couch_mrview_updater,'-map_docs/2-fun-0-',3},{lists,foldl,3},{couch_mrview_updater,map_docs,2}]}
      
      
      [Wed, 12 Feb 2014 09:55:59 GMT] [info] [<0.142.0>] 10.214.8.25 - - GET /registry/_design/ui/_view/updated?include_docs=false&limit=15&descending=true 500
      [Wed, 12 Feb 2014 09:55:59 GMT] [info] [<0.164.0>] 10.214.8.45 - - GET /registry/_design/ui/_view/updated?include_docs=false&limit=15&descending=true 500
      [Wed, 12 Feb 2014 09:55:59 GMT] [info] [<0.180.0>] 10.214.8.35 - - GET /registry/_design/ui/_view/updated?include_docs=false&limit=15&descending=true 500
      [Wed, 12 Feb 2014 09:55:59 GMT] [info] [<0.186.0>] 10.214.8.33 - - GET /registry/_design/ui/_list/dependencies_limit/dependencies?list_limit=15&descending=true&group=true 500
      [Wed, 12 Feb 2014 09:55:59 GMT] [info] [<0.184.0>] 10.214.8.23 - - GET /registry/_design/ui/_list/search/search?limit=25&endkey=%22allZZZZZZZZZZZZZZZZZZZ%22&startkey=%22all%22 500
      [Wed, 12 Feb 2014 09:55:59 GMT] [info] [<0.247.0>] 10.214.8.40 - - GET /registry/_design/ui/_view/updated?include_docs=false&limit=15&descending=true 500
      [Wed, 12 Feb 2014 09:55:59 GMT] [info] [<0.176.0>] 10.214.8.48 - - GET /registry/_design/ui/_list/search/search?limit=25&endkey=%22alZZZZZZZZZZZZZZZZZZZ%22&startkey=%22al%22 500
      [Wed, 12 Feb 2014 09:55:59 GMT] [info] [<0.139.0>] 10.214.8.38 - - GET /registry/_design/ui/_list/dependencies_limit/dependencies?list_limit=15&descending=true&group=true 500
      [Wed, 12 Feb 2014 09:55:59 GMT] [info] [<0.141.0>] 10.214.8.18 - - GET /registry/_design/ui/_list/dependencies_limit/dependencies?list_limit=15&descending=true&group=true 500
      [Wed, 12 Feb 2014 09:55:59 GMT] [info] [<0.138.0>] 10.214.8.28 - - GET /registry/_design/ui/_list/search/search?limit=25&endkey=%22ZZZZZZZZZZZZZZZZZZZ%22&startkey=%22%22 500
      [Wed, 12 Feb 2014 09:55:59 GMT] [info] [<0.165.0>] 10.214.8.42 - - GET /registry/_design/ui/_list/dependencies_limit/dependencies?list_limit=15&descending=true&group=true 500
      [Wed, 12 Feb 2014 09:55:59 GMT] [info] [<0.166.0>] 10.214.8.13 - - GET /registry/_design/ui/_list/search/search?limit=25&endkey=%22aZZZZZZZZZZZZZZZZZZZ%22&startkey=%22a%22 500
      [Wed, 12 Feb 2014 09:55:59 GMT] [error] [<0.180.0>] httpd 500 error response:
       {"error":"os_process_error","reason":"OS process timed out."}
      
      [Wed, 12 Feb 2014 09:55:59 GMT] [error] [<0.247.0>] httpd 500 error response:
       {"error":"os_process_error","reason":"OS process timed out."}
      
      [Wed, 12 Feb 2014 09:55:59 GMT] [error] [<0.139.0>] httpd 500 error response:
       {"error":"os_process_error","reason":"OS process timed out."}
      
      [Wed, 12 Feb 2014 09:55:59 GMT] [error] [<0.138.0>] httpd 500 error response:
       {"error":"os_process_error","reason":"OS process timed out."}
      

      I deleted the file d219c0be7f48a555a4ad0137e9b2b600.view and the index process started over from beginning but after "os_process_timeout" I got the same error (proces couchjs held 100% cpu).

      Both versions 1.4 and 1.5 of couchdb are afected.

      My hardware is:
      4x CPU
      4 GB RAM
      CouchDB database file is on 500GB NFS store.

      In three trials process always stops at 9090 element.

      View from the "status":

      Type Object Started on Last updated on PID Status
      Indexer registry, _design/ui <DATE> <DATE> <Proces_PID> Processed 9090 of 12257 changes

      Attachments

        Activity

          People

            Unassigned Unassigned
            Mr.Q Kris
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: