The remove-scm-tag phase of release:rollback is currently unimplemented - see the TODO in RemoveScmTagPhase.
Allow tags to be removed with Git implementation
Rolling back a release does not remove the created tag in subversion
release:rollback should delete tag
Mercurial: release:rollback does not remove newly created tag
document that tags are not rolled back in a release rollback
GitHub Pull Request #29