Uploaded image for project: 'Apache Liminal'
  1. Apache Liminal
  2. LIMINAL-57

Global configurations at different levels with overrides

    XMLWordPrintableJSON

Details

    Description

      Support in the following configuration abilities: 

       - Hierarchical Config

      liminal.yml can be one of the following two types: 

      1. superliminal (type: super) 
        superliminal used to define defaults behavior and can have only default configurations (pipeline_deafults, task_defaults, executors, etc..). 
      2. subliminal (type: sub) [default] 
        subliminal is the lowermost level in liminal inheritance.  Define the specific pipelines 

      `Hyperliminal` is to be a specific file of type `super` for defaults to enabling the local running of applications without special configurations. all liminal systems also inherit from the `Hyperliminal` file at their topmost level_

      For example:

       - Variables 

       - images (liminal config level) 

      Attachments

        1. HierarchicalConfig.png
          91 kB
          Zion Rubin
        2. CWEphemeralEMR.yml
          2 kB
          Zion Rubin
        3. spark-ml-pipeline-example.yml
          1 kB
          Zion Rubin
        4. hyperliminal.yml
          1 kB
          Zion Rubin
        5. spark-ml-full-pipeline-result.yml
          2 kB
          Zion Rubin

        Issue Links

          Activity

            People

              zionrubin Zion Rubin
              zionrubin Zion Rubin
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m