Uploaded image for project: 'Forrest (Retired)'
  1. Forrest (Retired)
  2. FOR-572

run a memory profiler while forrest is operating

Details

    • Task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.8
    • 0.11
    • Core operations
    • None

    Description

      We need to run a memory profiler while forrest is operating.

      Attachments

        1. step1_profiling.patch
          3 kB
          Ronald Blaschke

        Issue Links

          Activity

            crossley David Crossley added a comment -
            A couple of recent forrest-dev threads:

            [HEADS_UP] SVN HEAD is broken
            http://marc.theaimsgroup.com/?l=forrest-dev&m=112086829603887

            possible memory problems
            http://marc.theaimsgroup.com/?l=forrest-dev&m=111958832520115
            crossley David Crossley added a comment - A couple of recent forrest-dev threads: [HEADS_UP] SVN HEAD is broken http://marc.theaimsgroup.com/?l=forrest-dev&m=112086829603887 possible memory problems http://marc.theaimsgroup.com/?l=forrest-dev&m=111958832520115
            crossley David Crossley added a comment -
            Some preliminary results ...

            Quick glimpse at Forrest's memory usage [FOR-572] Ron Blaschke
            http://www.mail-archive.com/dev%40forrest.apache.org/index.html#03540
            crossley David Crossley added a comment - Some preliminary results ... Quick glimpse at Forrest's memory usage [ FOR-572 ] Ron Blaschke http://www.mail-archive.com/dev%40forrest.apache.org/index.html#03540
            crossley David Crossley added a comment -
            Another separate discussion thread:

            possible memory problems FOR-572 (Was: svn commit: r226346)
            http://www.mail-archive.com/dev%40forrest.apache.org/index.html#03562
            crossley David Crossley added a comment - Another separate discussion thread: possible memory problems FOR-572 (Was: svn commit: r226346) http://www.mail-archive.com/dev%40forrest.apache.org/index.html#03562
            crossley David Crossley added a comment -
            Another separate discussion thread:

            Deeper Look at Memory Issue, Maybe Successful
            http://marc.theaimsgroup.com/?t=112371108100008
            crossley David Crossley added a comment - Another separate discussion thread: Deeper Look at Memory Issue, Maybe Successful http://marc.theaimsgroup.com/?t=112371108100008
            crossley David Crossley added a comment -
            Another separate discussion thread:

            Quick glimpse at Forrest's build times
            http://marc.theaimsgroup.com/?t=112377044900006
            crossley David Crossley added a comment - Another separate discussion thread: Quick glimpse at Forrest's build times http://marc.theaimsgroup.com/?t=112377044900006
            I reported the issue to Cocoon.

            Possible Memory Leak with LinkRewriterTransformer
            http://issues.apache.org/bugzilla/show_bug.cgi?id=36162
            rblasch Ronald Blaschke added a comment - I reported the issue to Cocoon. Possible Memory Leak with LinkRewriterTransformer http://issues.apache.org/bugzilla/show_bug.cgi?id=36162
            crossley David Crossley added a comment -
            Another relevant thread:
            Profiling Forrest [FOR-572]
            http://marc.theaimsgroup.com/?l=forrest-dev&m=112456323907116
            crossley David Crossley added a comment - Another relevant thread: Profiling Forrest [ FOR-572 ] http://marc.theaimsgroup.com/?l=forrest-dev&m=112456323907116
            This patch adds partial support for profiling through Cocoon pipelines.
            You still need to replace the /standard pipes/ with the /profiling pipes/ in
            sitemap.xmap.

            The profiling results can be accessed via http://localhost:8888/profile.html during "forrest run".
            Note that you need to load a page first, to get some profiling data.

            Also note that after this change "profile.html" is reserved for the profiling page. This will
            go away after step 1 below, I guess.

            Next steps probably are:
            1) Refactor profiler.xmap into a (output) plugin, probably including a profile2document stylesheet
            2) Find out how to automatically replace the pipes with their profiling counterparts
            3) Find out how to best get some "profile.html" during static site generation

            Ron
            rblasch Ronald Blaschke added a comment - This patch adds partial support for profiling through Cocoon pipelines. You still need to replace the /standard pipes/ with the /profiling pipes/ in sitemap.xmap. The profiling results can be accessed via http://localhost:8888/profile.html during "forrest run". Note that you need to load a page first, to get some profiling data. Also note that after this change "profile.html" is reserved for the profiling page. This will go away after step 1 below, I guess. Next steps probably are: 1) Refactor profiler.xmap into a (output) plugin, probably including a profile2document stylesheet 2) Find out how to automatically replace the pipes with their profiling counterparts 3) Find out how to best get some "profile.html" during static site generation Ron
            crossley David Crossley added a comment -
            Thanks. Applied patch step1_profiling.patch (3 kb)
            crossley David Crossley added a comment - Thanks. Applied patch step1_profiling.patch (3 kb)
            rgardler Ross Gardler added a comment -
            No idea if this is any use, just spotted a reference to it on Cocoon user list:

            http://svn.apache.org/viewcvs.cgi/cocoon/branches/BRANCH_2_1_X/tools/instrumentation/readme.txt?view=markup
            rgardler Ross Gardler added a comment - No idea if this is any use, just spotted a reference to it on Cocoon user list: http://svn.apache.org/viewcvs.cgi/cocoon/branches/BRANCH_2_1_X/tools/instrumentation/readme.txt?view=markup
            crossley David Crossley added a comment -
            Related to comment above [29/Aug/05 08:57 PM] ...
            See a description of how to run the basic Cocoon Profiler
            http://forrest.apache.org/docs_0_80/howto/howto-dev.html#debug
            ... profiling is much more of course, but that is a start.
            crossley David Crossley added a comment - Related to comment above [29/Aug/05 08:57 PM] ... See a description of how to run the basic Cocoon Profiler http://forrest.apache.org/docs_0_80/howto/howto-dev.html#debug ... profiling is much more of course, but that is a start.
            williamstw Tim Williams added a comment -
            As David suggested in the mail below, this is an issue that is a holding area for lots of good info. This should just be turned into a doc somewhere.

            http://marc.theaimsgroup.com/?t=115188972100002&r=1&w=2
            williamstw Tim Williams added a comment - As David suggested in the mail below, this is an issue that is a holding area for lots of good info. This should just be turned into a doc somewhere. http://marc.theaimsgroup.com/?t=115188972100002&r=1&w=2
            williamstw Tim Williams added a comment -
            Honestly, I don't know what the real issue is here. The other one, FOR-591, had a concrete, testable problem but this one doesn't. It does have tons of good references though. I'm moving to 0.10 for now. If someone can articulate what the problem is, we can move it back.
            williamstw Tim Williams added a comment - Honestly, I don't know what the real issue is here. The other one, FOR-591 , had a concrete, testable problem but this one doesn't. It does have tons of good references though. I'm moving to 0.10 for now. If someone can articulate what the problem is, we can move it back.
            gmcdonald Gavin McDonald added a comment -
            Move this out to 0.11
            gmcdonald Gavin McDonald added a comment - Move this out to 0.11

            People

              Unassigned Unassigned
              crossley David Crossley
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated: