[CALCITE-2168] Implement a General Purpose Benchmark for Calcite

• Type: Wish
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: core
• Labels: performance
• Assignee: Edmon Begoli
• Reporter: Edmon Begoli
• Created: 06/Feb/18 01:51
• Updated: 17/Apr/18 15:35

Description

Develop a benchmark that can be used for general purpose benchamrking of Calcite against other frameworks, and databases, and for study,research, and profiling of the framwork.

Use popular benchmarks such as TCP-DS (or -H) or Star Schema Benchmark (SSB) and measure the performance of optimized vs. unoptimized Calcite queries, and the overhead of going through Calcite adapters vs. natively accessing the target DB

Look into the existing approaches and do perhaps something similar:
* https://www.slideshare.net/julianhyde/w-435phyde-3
* https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_hive-performance-tuning/content/ch_cost-based-optimizer.html

• (How much of this is still relevant (Hive 0.14)? Can we use queries/benchmarks?)
  https://hortonworks.com/blog/hive-0-14-cost-based-optimizer-cbo-technical-overview/