Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20172

Event log without read permission should be filtered out before actually reading it

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.2.0
    • 2.2.0
    • Spark Core
    • None

    Description

      In the current Spark's HistoryServer, we expected to check file permission when listing all the files, and filter out this files with no read permission. That was not worked because we actually doesn't check the access permission, so we defer this permission check until reading files, that is not necessary and the exception is printed out in every 10 seconds by default.

      So to avoid this problem we should add a access check logic in listing files.

      Attachments

        Activity

          People

            jerryshao Saisai Shao
            jerryshao Saisai Shao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: