[ORC-913] Support data/format/compress options in Spark benchmark

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.7.0, 1.8.0
• Fix Version/s: 1.7.0, 1.8.0
• Component/s: Java
• Labels: starter
• Assignee: William Hyun
• Reporter: Dongjoon Hyun
• Created: 06/Aug/21 15:56
• Updated: 21/Sep/21 20:44
• Resolved: 07/Aug/21 16:05

Description

Currently, Spark benchmark jar supports the JMH options.

$ java -jar bench/spark/target/orc-benchmarks-spark-1.8.0-SNAPSHOT.jar spark -h
usage: java -jar <jar> <command> <options> <data>
 -f,--fork <arg>                How many forks to use
 -g,--gc                        Should GC be profiled
 -h,--help                      Provide help
 -i,--iterations <arg>          Number of iterations
 -I,--warmup-iterations <arg>   Number of warmup iterations
 -m,--min-memory <arg>          The minimum size of each JVM
 -M,--max-memory <arg>          The maximum size of each JVM
 -p,--stack                     Should enable stack profiler in JMH
 -t,--time <arg>                How long each iteration is in seconds

`core` benchmark jar file supports `format`/`data`/`compress` options. It would be great if Spark benchmark jar also supports its parameter options too.

$ java -jar bench/core/target/orc-benchmarks-core-*-uber.jar generate -h
usage: convert <root>
 -c,--compress <arg>   List of compression
 -d,--data <arg>       List of data sets
 -f,--format <arg>     List of formats
 -h,--help             Provide help
 -s,--sales <arg>      Number of records for sales

Issue Links

• links to: GitHub Pull Request #825