Issue Details (XML | Word | Printable)

Key: STDCXX-366
Type: Wish Wish
Status: Open Open
Priority: Minor Minor
Assignee: Unassigned
Reporter: Andrew Black
Votes: 0
Watchers: 0
Operations

If you were logged in you would be able to see more operations.
C++ Standard Library

Add benchmarking framework

Created: 20/Mar/07 04:34 PM   Updated: 16/Jan/08 10:19 PM
Return to search
Component/s: Tests
Affects Version/s: None
Fix Version/s: 4.3.0

Time Tracking:
Not Specified

Environment: N/A
Issue Links:
Reference
 


 Description  « Hide
The Apache C++ Standard library is intended to be a high performance implementation of the C++ Standard Library. To this end, we have created a few benchmarking applications, but no systematic effort has been made to create a set of benchmarking executables, and no infrastructure exists to build and run such executables in a uniform manner.

We should create a benchmarking infrastructure, modeled on the test infrastructure. This would likely include a makefile, some kind of benchmark runner (similar to the exec utility), a (thin) benchmark driver library, and a set of benchmark programs, each testing a particular class, method, or set of methods.



 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Andrew Black added a comment - 16/May/07 02:45 PM
On the stdcxx-dev email list, Eric Lemmings started a discussion related to benchmarking, with a thread parent of http://mail-archives.apache.org/mod_mbox/incubator-stdcxx-dev/200705.mbox/%3cD730FF7CEDDCA64483F9E99D999A158B012F60A1@qxvcexch01.ad.quovadx.com%3e

The primary link mentioned was http://www.open-std.org/jtc1/sc22/wg21/docs/papers/2007/n2271.html . This page discusses the Electronic Arts Standard Template Library (EASTL). A later link he provided in the thread was to http://www.stepanovpapers.com/container_benchmark.cpp , which looks to be a benchmark someone created for the STL containers.

Another recent thread from the mailing list is http://mail-archives.apache.org/mod_mbox/incubator-stdcxx-dev/200705.mbox/%3c464937D4.5080907@gmail.com%3e . This was started by Mark Brown, and contains a benchmark for the ofstream class. A much older thread ( http://mail-archives.apache.org/mod_mbox/incubator-stdcxx-dev/200602.mbox/%3c43ECE5A3.1070609@roguewave.com%3e) was started by myself in February 2006. This thread contained a benchmark setup for the stringstream class. This thread resulted in the filing of STDCXX-142 and STDCXX-149.


Martin Sebor made changes - 16/May/07 03:47 PM
Field Original Value New Value
Link This issue relates to STDCXX-142 [ STDCXX-142 ]
Martin Sebor made changes - 16/May/07 03:48 PM
Link This issue relates to STDCXX-149 [ STDCXX-149 ]
Andrew Black added a comment - 24/Aug/07 11:52 PM
Scheduling for 4.2.1, though it may be differed again.

Andrew Black made changes - 24/Aug/07 11:52 PM
Fix Version/s 4.2.1 [ 12312690 ]
Martin Sebor added a comment - 16/Jan/08 10:19 PM
Nice to have but too much work for 4.2.1. Deferred.

Martin Sebor made changes - 16/Jan/08 10:19 PM
Fix Version/s 4.2.1 [ 12312690 ]
Fix Version/s 4.3 [ 12312692 ]