Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-27244

Redact Passwords While Using Option logConf=true

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.3.0, 2.3.2, 2.3.3, 2.4.0
    • Fix Version/s: 2.3.4, 2.4.2, 3.0.0
    • Component/s: Spark Core
    • Labels:
      None

      Description

      When logConf is set to true and any sensitive information like passwords is set using spark-submit command then the passwords are logged in clear text from conf. Ideally, these passwords should be redacted as it does on UI and then printed to log for debugging purpose.

        Attachments

          Activity

            People

            • Assignee:
              needna78 Ninad
              Reporter:
              needna78 Ninad
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: