[ARROW-5544] [Archery] should not return non-zero in `benchmark diff` sub command on regression

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.14.0
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/21990
• Assignee: Francois Saint-Jacques
• Reporter: Francois Saint-Jacques
• Created: 10/Jun/19 17:03
• Updated: 11/Jan/23 07:41
• Resolved: 11/Jun/19 11:19

Description

When a regression is detected, but the command ran successfully, it should return zero. Currently it returns the number of regression. This is to play better with ursabot. It should be left to the user to decide what to do with the json data.

Issue Links

• links to: GitHub Pull Request #4512