Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23567

spark.redaction.regex should not include user by default, docs not updated

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.2.1
    • Fix Version/s: None
    • Component/s: Spark Core
    • Labels:
      None

      Description

      SPARK-22479 changed to redact the user name by default.  I would argue username isn't something that should be redacted by default and its very useful for debugging and other things. If people are running super secure and want to turn it on they can but I don't see the user name as a default security setting.  There are also other ways on the UI to see the user name, for instance on yarn you can go to the Environment page and looking at the resources and see the username in the paths.

      Also the Jira did not update the default setting in the docs, so the docs are out of date:

      http://spark.apache.org/docs/2.2.1/configuration.html

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                tgraves Thomas Graves
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: