[FLINK-22678] Adjust configuration of ChangelogStateBackend and hide it from users

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.14.0
• Component/s: Runtime / State Backends
• Labels: pull-request-available
• Assignee: Zakelly Lan
• Reporter: Yuan Mei
• Created: 17/May/21 05:57
• Updated: 28/Aug/21 12:20
• Resolved: 22/Jun/21 02:58

Description

Per discussion on the mailing thread:
https://lists.apache.org/thread.html/ra178ce29088b1da362d98a5a6d8c7be48051caf1637ee24261738217%40%3Cdev.flink.apache.org%3E

We decide to make a refined version of loading ChangelogStateBackend:

• Define consistent override and combination policy (flag + state backend) in different config levels
• Define explicitly the meaning of "enable flag" = true/false/unset
• Hide ChangelogStateBackend from users

Details described in
https://docs.google.com/document/d/13AaCf5fczYTDHZ4G1mgYL685FqbnoEhgo0cdwuJlZmw/edit?usp=sharing

Issue Links

• causes: FLINK-23104 flink-statebackend-changelog does not build with scala 2.12
• is related to: FLINK-21354 Add ChangelogStateBackend (proxy-everything)
• is related to: FLINK-23075 Python API for enabling ChangelogStateBackend
• links to: GitHub Pull Request #16153