Uploaded image for project: 'Community Development'
  1. Community Development
  2. COMDEV-412

Apache DolphinScheduler-Parameter coverage

    XMLWordPrintableJSON

Details

    Description

      Apache DolphinScheduler

      Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of the box.

      Page:https://dolphinscheduler.apache.org
      GitHub: https://github.com/apache/incubator-dolphinscheduler

      Background:
      Configuration parameter override

      At present, our parameter configuration is mainly based on configuration files: you can refer to PropertiesUtils,

      But usually important parameters will be injected through the form of Java runtime virtual machine parameters, so we need to support this way of parameter injection. At the same time, because different ways of parameter injection have different priorities, we need to achieve configuration coverage. There are two main situations at present, SystemProperties and LocalFile. The priority of SystemProperties should be the highest, followed by LocalFile (that is, our various configuration files, such as master.properties).

      issue:
      https://github.com/apache/incubator-dolphinscheduler/issues/5164

      for example:
      1: Configure master.max.cpuload.avg=-1 in master.prperties

      2: Java runtime virtual machine parameters -Dmaster.max.cpuload.avg=1

      3:PropertiesUtils.get("master.max.cpuload.avg") = 1

      Task: realize configuration parameter coverage

      Mentor: CalvinKirs kirs@apache.org

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              kirs Calvin Kirs
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: