Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10473

EventLog will loss message in the long-running security application

    Details

    • Type: Bug
    • Status: In Progress
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.5.0, 1.6.0
    • Fix Version/s: None
    • Component/s: Spark Core, Web UI
    • Labels:
      None

      Description

      In the implementation of EventLoggingListener , there is only one OutputStream writing event message to HDFS.
      But when the token of the DFSClient in the "OutputStream" was expired, the "DFSClient" had no right to write the message and miss all the message behind.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              carlmartin carlmartin
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Due:
                Created:
                Updated: