Axis2 Performance Check

• Key: AXIS2-172
• Type: Wish
• Status: Resolved
• Resolution: Fixed
• Priority: Minor
• Assignee: Davanum Srinivas
• Reporter: Eran Chinthaka

Description

We had a performance and profiler check on Axis2 when we released M1. But after that we couldn't do it.
For testing AXIOM, we used Sosnoski's XML bench.
IMO, its better to do these again, before we release 1.0.

Comments

[Dennis Sosnoski]

I can write a version of the test for Axis2/XMLBeans so that it'll be directly comparable with the Axis results. I think I'm missing some steps in how to actually start from WSDL and build both client and server versions of code using XMLBeans. Is this documented somewhere I've overlooked?

I assume I want to start by generating XMLBeans classes from the WSDL, I'm just unclear on the details of hooking them in to Axis2 on both ends.

[Dennis Sosnoski]

In the above comment I was referring to my web services performance test, at http://www.sosnoski.com/presents/cleansoap/comparing.html I know this was used for some tests on Axis 1.2, and at first glance I assumed this was what you were referring to in the description. It's probably a decent starting point for Axis2 tests in any case, since it gives a baseline covering several different frameworks.

[Eran Chinthaka]

Well, I was referring to the XMLBench to check the performance of AXIOM.

Anyway we wanna do the Axis2 engine perf check too. Hope your approach will be fine on that.

[Dennis Sosnoski]

Taking a look at the current AXIOM code, I can guarantee that the memory usage is going to be considerably higher than any of the standard document models for whatever portion of the tree actually gets built. The OMNodeImpl class alone has 4 object references, and int, and a boolean, for a minimum size of 21 bytes. The OMElementImpl class adds another 6 object references and 2 ints, for a mimum size of 53 bytes. OMTextImpl adds 7 object references and 2 booleans to OMNodeImpl, for a minimum size of 52 bytes. These are much larger than the equivalent classes from standard document models (JDOM, for instance, has 6 object references in its Element class, for a minimum size of 24 bytes, and just 2 object references in its Text class, for a minimum size of 8 bytes).

Do you still have the XMLBench code you used for testing the M1 AXIOM? It's probably a good idea to try another test run as we're nearing the 1.0 release.

[Deepal Jayasinghe]

Dims:
I know that you did a great job to improve axom performance , I think we are in a position to close this issue.

[Eran Chinthaka]

Hmm, I think Axiom perf check is just one part of this.

We need to run some perf test on things like round trip time and memory and try to improve them. So lets not close this.

[Davanum Srinivas]

Yep. Please don't close this.

-- dims

[Eran Chinthaka]

Performance test already done and logged in here http://www.wso2.net/2006/05/axis2_performance_testing_round_1.