[FLINK-15143] Create document for FLIP-49 TM memory model and configuration guide

• Type: Sub-task
• Status: Closed
• Priority: Blocker
• Resolution: Done
• Affects Version/s: 1.10.0
• Fix Version/s: 1.9.3, 1.10.1
• Component/s: Documentation
• Labels: pull-request-available
• Assignee: Andrey Zagrebin
• Reporter: Xintong Song
• Created: 09/Dec/19 08:23
• Updated: 10/May/20 12:07
• Resolved: 10/Feb/20 18:42

Description

In release 1.10, with FLIP-49, we introduced significant changes to the TaskExecutor memory model and it's related configuration options / logics.

It is very important that we clearly state the changes and potential effects, and guide our users to tune their clusters with the new configuration for both new setups and migrations of previous setups. And we should do that for both documentation and the release note.

Issue Links

• is blocked by: FLINK-15145 Tune default values for FLIP-49 TM memory configurations with real production jobs.
• is duplicated by: FLINK-15144 Document performance related changes caused by FLIP-49
• is related to: FLINK-15103 Performance regression on 3.12.2019 in various benchmarks
• is related to: FLINK-13980 FLIP-49 Unified Memory Configuration for TaskExecutors
• is related to: FLINK-15991 Create Chinese documentation for FLIP-49 TM memory model
• is related to: FLINK-16278 Document new settings for MaxMetaSpace in 1.10
• links to: Gdoc draft
• links to: GitHub Pull Request #10999
• links to: GitHub Pull Request #11004