[SPARK-10473] EventLog will loss message in the long-running security application

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 1.5.0, 1.6.0
• Component/s: Spark Core, Web UI
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Zhaowei Huang
• Created: 07/Sep/15 11:15
• Updated: 21/May/19 04:14
• Resolved: 21/May/19 04:14

Description

In the implementation of EventLoggingListener , there is only one OutputStream writing event message to HDFS.
But when the token of the DFSClient in the "OutputStream" was expired, the "DFSClient" had no right to write the message and miss all the message behind.

Issue Links

• links to: [Github] Pull Request #8942 (SaintBacchus)