[CALCITE-6470] Run specific JMH benchmarks without modifying sources

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.38.0
• Component/s: build
• Labels: pull-request-available
• Assignee: Stamatis Zampetakis
• Reporter: Stamatis Zampetakis
• Created: 15/Jul/24 13:49
• Updated: 17/Oct/24 22:41
• Resolved: 17/Oct/24 22:41

Description

Currently we can run all JMH benchmarks of the project using the "jmh" Gradle task.

./gradlew :ubenchmark:jmh

In many cases, we don't want to run all benchmarks but only one (or few) and this is not possible without modifying the Gradle build files (see https://github.com/melix/jmh-gradle-plugin/issues/152).

The goal of this ticket is to add a (project) property (i.e., jmh.includes) to select the desired benchmarks via a regular expression that can be passed in the command line.

./gradlew :ubenchmark:jmh -Pjmh.includes=ParserBenchmark

For example, the command above would run only the ParserBenchmark.

Issue Links

• links to: GitHub Pull Request #3857