[SPARK-49216] Fix to not log message context with explicitly LogEntry constructed when Structured Logging conf is off

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Spark Core
• Labels: pull-request-available
• Assignee: Xinyi Yu
• Reporter: Xinyi Yu
• Created: 13/Aug/24 03:53
• Updated: 13/Aug/24 21:32
• Resolved: 13/Aug/24 21:32

Description

To use structured logging developers usually do

logInfo(log"Lost executor ${MDC(LogKeys.EXECUTOR_ID, "1")}."), 

When the structured logging conf is off, the context is not logged.
However if explicitly constructing the LogEntry and calling the public API,

logInfo(
  MessageWithContext(
    "Lost executor 1.",
    new java.util.HashMap[String, String] { put(LogKeys.EXECUTOR_ID.name, "1") }
  )
) 

the conf does not take effect and even when it is off, the context is still logged.

The behavior should be fixed.

Issue Links

• links to: GitHub Pull Request #47732