Basically the port of https://github.com/apache/arrow/blob/master/dev/release/changelog.py
GitHub Pull Request #2348