[ARROW-14976] [Dev][Archery] Print more friendly error logs for non-existent benchmark

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 7.0.0
• Component/s: Archery
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/30498
• Assignee: Yibo Cai
• Reporter: Yibo Cai
• Created: 03/Dec/21 09:29
• Updated: 11/Jan/23 08:43
• Resolved: 09/Dec/21 01:51

Description

For non-existent benchmark, archery benchmark tool outputs error messages not very useful.
E.g., a typo (parser -> parsing) in command "archery benchmark diff --suite-filter=arrow-csv-parsing-benchmark" leads to below confusing error message:

Traceback (most recent call last):
  File "pandas/_libs/index.pyx", line 108, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/hashtable_class_helper.pxi", line 1533, in pandas._libs.hashtable.Float64HashTable.get_item
TypeError: must be real number, not str

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/cyb/venv/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 3361, in get_loc
    return self._engine.get_loc(casted_key)
  File "pandas/_libs/index.pyx", line 76, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/index.pyx", line 111, in pandas._libs.index.IndexEngine.get_loc
KeyError: 'change'

Issue Links

• links to: GitHub Pull Request #11865