Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-25219

load configuration from flink-conf.yaml, some of my parameters were modified

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Flink uses the following method to parse flink-conf.yaml.

      When there are # characters in my parameters, they will be modified.

      for example:

      flink-conf.yaml  :  s3.secret-key=abc#123

      At the end i will get ‘ s3.secret-key=abc’

      Why not use a better way to process flink-conf.yaml? like snakeyaml

      String[] comments = line.split("#", 2);
      String conf = comments[0].trim();
      
      // 2. get key and value
      if (conf.length() > 0) {
          String[] kv = conf.split(": ", 2); 

      Attachments

        Activity

          People

            Unassigned Unassigned
            sjq jackie
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: