Uploaded image for project: 'CouchDB'
  1. CouchDB
  2. COUCHDB-768

Constant Bulk Saving results in Eventual Timeouts

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: 0.10.2, 0.11
    • Fix Version/s: None
    • Component/s: HTTP Interface
    • Labels:
    • Environment:
    • Skill Level:
      Regular Contributors Level (Easy to Medium)

      Description

      Situation:
      Saving documents in bulk (lots of 1,000, 4,000, and 10,000 have been tested) to a single database results in degraded performance, and then a string of timeouts. The timeouts are not logged by CouchDB, so the HTTP interface becomes unusable for a period. It then returns and rapidly processes the next batch of jobs (read: the timeout is temporary).

      Replication:

      • I am having trouble replicating the behaviour with saving bulk loads of documents (I have been working against doing so), but it appears to happen after an extended period;
      • I can replicate the behaviour by submitting a lot of individual files (single document saves) in rapid succession.

      Diagnostics:

      • I had tried true and false for delayed_commits, just to rule that out;
      • Testing outside of CouchDB (postgres, file transfers, streaming, or otherwise trying to hammer the I/O) yielded no issues with the systems involved.

      Functional Workarounds:

      • I have sharded the database in question.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              swixel A.W. Stanley
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: