VolcanoPlanner does not remove the entry in ruleNames when removing a rule[1].
[1]https://github.com/chunweilei/calcite/blob/master/core/src/main/java/org/apache/calcite/plan/volcano/VolcanoPlanner.java#L490-L513
GitHub Pull Request #1825