[SPARK-38443] Document config STREAMING_SESSION_WINDOW_MERGE_SESSIONS_IN_LOCAL_PARTITION

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: Structured Streaming
• Assignee: L. C. Hsieh
• Reporter: L. C. Hsieh
• Created: 08/Mar/22 07:51
• Updated: 09/Mar/22 01:06
• Resolved: 09/Mar/22 01:06

Description

We have use case the customer faces issue on large shuffle write in session window. The config is hidden, although it is useful for such case. We should document it so end users can find it easily.

Issue Links

• links to: [Github] Pull Request #35762 (viirya)
• links to: [Github] Pull Request #35762 (viirya)