run a memory profiler while forrest is operating

• Key: FOR-572
• Type: Task
• Status: Open
• Priority: Critical
• Assignee: Unassigned
• Reporter: David Crossley
• Component/s: Core operations
• Affects Version/s: 0.8
• Fix Version/s: 0.9-dev

Description

We need to run a memory profiler while forrest is operating.

Comments

[David Crossley]

A couple of recent forrest-dev threads:

[HEADS_UP] SVN HEAD is broken
http://marc.theaimsgroup.com/?l=forrest-dev&m=112086829603887

possible memory problems
http://marc.theaimsgroup.com/?l=forrest-dev&m=111958832520115

[David Crossley]

Some preliminary results ...

Quick glimpse at Forrest's memory usage [FOR-572] Ron Blaschke
http://www.mail-archive.com/dev%40forrest.apache.org/index.html#03540

[David Crossley]

Another separate discussion thread:

possible memory problems FOR-572 (Was: svn commit: r226346)
http://www.mail-archive.com/dev%40forrest.apache.org/index.html#03562

[David Crossley]

Another separate discussion thread:

Deeper Look at Memory Issue, Maybe Successful
http://marc.theaimsgroup.com/?t=112371108100008

[David Crossley]

Another separate discussion thread:

Quick glimpse at Forrest's build times
http://marc.theaimsgroup.com/?t=112377044900006

[Ron Blaschke]

I reported the issue to Cocoon.

Possible Memory Leak with LinkRewriterTransformer
http://issues.apache.org/bugzilla/show_bug.cgi?id=36162

[David Crossley]

Another relevant thread:
Profiling Forrest [FOR-572]
http://marc.theaimsgroup.com/?l=forrest-dev&m=112456323907116

[Ron Blaschke]

This patch adds partial support for profiling through Cocoon pipelines.
You still need to replace the /standard pipes/ with the /profiling pipes/ in
sitemap.xmap.

The profiling results can be accessed via http://localhost:8888/profile.html during "forrest run".
Note that you need to load a page first, to get some profiling data.

Also note that after this change "profile.html" is reserved for the profiling page. This will
go away after step 1 below, I guess.

Next steps probably are:
1) Refactor profiler.xmap into a (output) plugin, probably including a profile2document stylesheet
2) Find out how to automatically replace the pipes with their profiling counterparts
3) Find out how to best get some "profile.html" during static site generation

Ron

[David Crossley]

Thanks. Applied patch step1_profiling.patch (3 kb)

[Ross Gardler]

No idea if this is any use, just spotted a reference to it on Cocoon user list:

http://svn.apache.org/viewcvs.cgi/cocoon/branches/BRANCH_2_1_X/tools/instrumentation/readme.txt?view=markup

[David Crossley]

Related to comment above [29/Aug/05 08:57 PM] ...
See a description of how to run the basic Cocoon Profiler
http://forrest.apache.org/docs_0_80/howto/howto-dev.html#debug
... profiling is much more of course, but that is a start.

[Tim Williams]

As David suggested in the mail below, this is an issue that is a holding area for lots of good info. This should just be turned into a doc somewhere.

http://marc.theaimsgroup.com/?t=115188972100002&r=1&w=2