Steps to reproduce this problem:
1. login admin console
2. Create a ActiveMQ resource connector with the wizard
3. Deploy it and check it is in running state
4. Click J2EE connector to uninstall it
5. Check JNDI viewer, you will see the JNDI entry still there, even you've uninstalled it.