All configuration files in kafka RPM SPEC file should be marked with %config prefix in %files section.
This would prevent overwrites during install/upgrade and uninstall operations
It's especially important to save configuration during package upgrades.
Section to change in SPEC file:
It would also be good to mark documentation files with %doc