[COUCHDB-325] Memory Leak in 9.0?

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.9
• Fix Version/s: 0.9

Environment

gentoo linux on c1.medium aws instance

• Assignee: Unassigned
• Reporter: Rohit Amarnath
• Created: 14/Apr/09 13:47
• Updated: 15/Apr/09 13:33
• Resolved: 15/Apr/09 13:33

Description

I am using couchrest to transform a document from one database to another (millions of records). The memory usage continues to increase till all the memory is used. The process occasionally fails, but usually completes. I dont know enough about ruby/couchrest/couchdb to be able to tell you where the memory is increasing from - but if you give me some direction, I will be happy to take a look.

If I comment out the save, it seems ok.

Here is the code:

--------------------------------

require 'rubygems'
require 'couchrest'

@db = CouchRest.database!("http://127.0.0.1:5984/xfpds_2008")
@db2 = CouchRest.database!("http://127.0.0.1:5984/fpds_2008")

@streamer = CouchRest::Streamer.new(@db)
@streamer.view("_all_docs") do |row|
begin

doc = @db.get(row["id"])

1. remove id so the new database gets fresh document
   doc.delete("_id")
   doc.delete("_rev")

1. change badgerfish notation to assign $ key value to parent
   doc["amounts"]["obligatedAmount"] = doc["amounts"]["obligatedAmount"]["$"]
   doc["amounts"]["baseAndAllOptionsValue"] = doc["amounts"]["baseAndAllOptionsValue"]["$"]
   doc["amounts"]["baseAndExercisedOptionsValue"] = doc["amounts"]["baseAndExercisedOptionsValue"]["$"]

...... A whole bunch of fields

1. save the document using bulk save
   response = @db2.save_doc(doc,true)

rescue

1. if streamer ends, save last few documents
   @db2.bulk_save
   end

end