Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10905

HadoopConfigLoader logs Credentials on DEBUG level

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Critical
    • Resolution: Invalid
    • None
    • None
    • FileSystems
    • None
    • This was invalid. Misinterpreted the logs.

    Description

      If you set S3 credentials via s3.access-key and s3.secret-key the credentials are logged on DEBUG level in HadoopConfigLoader:104.

      job-cluster_1 | 2018-11-15 18:02:25,248 DEBUG org.apache.flink.fs.s3presto.shaded.org.apache.flink.runtime.fs.hdfs.HadoopConfigLoader - Adding Flink config entry for s3.secret-key as presto.s3.secret-key=minio123 to Hadoop config
      job-cluster_1 | 2018-11-15 18:02:25,248 DEBUG org.apache.flink.fs.s3presto.shaded.org.apache.flink.runtime.fs.hdfs.HadoopConfigLoader - Adding Flink config entry for s3.endpoint as presto.s3.endpoint=http://172.17.0.1:9001 to Hadoop config
      job-cluster_1 | 2018-11-15 18:02:25,248 DEBUG org.apache.flink.fs.s3presto.shaded.org.apache.flink.runtime.fs.hdfs.HadoopConfigLoader - Adding Flink config entry for s3.access-key as presto.s3.access-key=minio to Hadoop config

      To be consistent we should hide these as in GlobalConfiguration.

      Attachments

        Activity

          People

            Unassigned Unassigned
            knaufk Konstantin Knauf
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: