Uploaded image for project: 'Slider'
  1. Slider
  2. SLIDER-481

Exports should allow a multiple line items per export and a more hierarchical structure

    Details

    • Sprint:
      Slider October #2

      Description

      The application exports are currently piggy-backing on configuration support in the registry. While this pushes the information out the layout of name-value pairs are not ideal for exports.

      For example:

      • Some exports can have array of values each related to a component instance
      • Some exports need additional tags such as which roles they belong to or which host they are on
      • Only JSON export should be sufficient

        Activity

        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 6f4c8b67e0d222581a7386bb4cdf8829f26877e7 in incubator-slider's branch refs/heads/feature/SLIDER-481_allow_dedicated_handling_of_exports from Sumit Mohanty
        [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=6f4c8b6 ]

        SLIDER-481. Exports should allow a multiple line items per export and a more hierarchical structure

        Show
        jira-bot ASF subversion and git services added a comment - Commit 6f4c8b67e0d222581a7386bb4cdf8829f26877e7 in incubator-slider's branch refs/heads/feature/ SLIDER-481 _allow_dedicated_handling_of_exports from Sumit Mohanty [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=6f4c8b6 ] SLIDER-481 . Exports should allow a multiple line items per export and a more hierarchical structure
        Hide
        sumitmohanty Sumit Mohanty added a comment - - edited

        Currently, exports are published using the same mechanism that is used to published configuration. While it gets the job done, it has some drawbacks:

        • exports may have multiple line items - e.g. a set of peer services all exposing an end point with the same "name"
        • exports may need to be associated with identifier/tag per container, update time per entry, even valid until time per entry
        • exports do not fit well into all formatting options for configs

        Proposal:

        Introduce a separate path (REST) for exports in parallel to the configurations.

        Example: org.apache.slider.publisher.exports http://c6401.ambari.apache.org:60815/ws/v1/slider/publisher/exports
        The child elements to the above are export groups. An export group is a logical grouping of exports that the app author can define.

        Example:

        "quicklinks": {
          "description": "quick links for app",
          "updated": 1413160329232,
          "updatedTime": "Mon Oct 13 00:32:09 UTC 2014",
          "entries": { },
          "empty": false
        }
        

        Each sub-entry will refer to an exported item which may have one or more entries.

        Example: http://c6401.ambari.apache.org:60815/ws/v1/slider/publisher/exports/quicklinks

        • value - exported value
        • containerId - id of the container that exported it
        • tag - (optional) tag associated with the container (SLIDER-463)
        • level - applicable to a component or the whole application
        • updateTime - when was it last updated
        • validUntil - (optional) till when the entry is valid
          "entries" : {
            "quorum_host_port": [
              {
                "value": "http://c6401.ambari.apache.org:8342/api",
                "containerId": "container_1412837132444_0012_01_000002",
                "tag": "1",
                "level": "component",
                "updateTime": "Mon Oct 13 00:32:09 UTC 2014",
                "validUntil": ""
              },
              {
                "value": "http://c6402.ambari.apache.org:28551/api",
                "containerId": "container_1412837132444_0012_01_000004",
                "tag": "2",
                "level": "component",
                "updateTime": "Mon Oct 13 00:36:23 UTC 2014",
                "validUntil": ""
              }
            ],
          
            "ganglia_ui":[
              {
                "value": "http://c6403.ambari.apache.org/ganglia/?c=App1",
                "containerId": "",
                "tag": "",
                "level": "application",
                "updateTime": "Mon Oct 13 00:32:09 UTC 2014",
                "validUntil": ""
              }
            ]
          }
          
        Show
        sumitmohanty Sumit Mohanty added a comment - - edited Currently, exports are published using the same mechanism that is used to published configuration. While it gets the job done, it has some drawbacks: exports may have multiple line items - e.g. a set of peer services all exposing an end point with the same "name" exports may need to be associated with identifier/tag per container, update time per entry, even valid until time per entry exports do not fit well into all formatting options for configs Proposal: Introduce a separate path (REST) for exports in parallel to the configurations. Example: org.apache.slider.publisher.exports http://c6401.ambari.apache.org:60815/ws/v1/slider/publisher/exports The child elements to the above are export groups. An export group is a logical grouping of exports that the app author can define. Example: "quicklinks": { "description": "quick links for app", "updated": 1413160329232, "updatedTime": "Mon Oct 13 00:32:09 UTC 2014", "entries": { }, "empty": false } Each sub-entry will refer to an exported item which may have one or more entries. Example: http://c6401.ambari.apache.org:60815/ws/v1/slider/publisher/exports/quicklinks value - exported value containerId - id of the container that exported it tag - (optional) tag associated with the container ( SLIDER-463 ) level - applicable to a component or the whole application updateTime - when was it last updated validUntil - (optional) till when the entry is valid "entries" : { "quorum_host_port": [ { "value": "http://c6401.ambari.apache.org:8342/api", "containerId": "container_1412837132444_0012_01_000002", "tag": "1", "level": "component", "updateTime": "Mon Oct 13 00:32:09 UTC 2014", "validUntil": "" }, { "value": "http://c6402.ambari.apache.org:28551/api", "containerId": "container_1412837132444_0012_01_000004", "tag": "2", "level": "component", "updateTime": "Mon Oct 13 00:36:23 UTC 2014", "validUntil": "" } ], "ganglia_ui":[ { "value": "http://c6403.ambari.apache.org/ganglia/?c=App1", "containerId": "", "tag": "", "level": "application", "updateTime": "Mon Oct 13 00:32:09 UTC 2014", "validUntil": "" } ] }
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 11d7e11386b3bc63f416217d44b63eb9558c213f in incubator-slider's branch refs/heads/feature/SLIDER-481_allow_dedicated_handling_of_exports from Sumit Mohanty
        [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=11d7e11 ]

        Revert "SLIDER-481. Exports should allow a multiple line items per export and a more hierarchical structure"

        This reverts commit 6f4c8b67e0d222581a7386bb4cdf8829f26877e7.

        Show
        jira-bot ASF subversion and git services added a comment - Commit 11d7e11386b3bc63f416217d44b63eb9558c213f in incubator-slider's branch refs/heads/feature/ SLIDER-481 _allow_dedicated_handling_of_exports from Sumit Mohanty [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=11d7e11 ] Revert " SLIDER-481 . Exports should allow a multiple line items per export and a more hierarchical structure" This reverts commit 6f4c8b67e0d222581a7386bb4cdf8829f26877e7.
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 1ef6a88f2867e54eb574ef76a0b92c79b10be3e8 in incubator-slider's branch refs/heads/feature/SLIDER-481_allow_dedicated_handling_of_exports from Sumit Mohanty
        [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=1ef6a88 ]

        Merge branch 'develop' into feature/SLIDER-481_allow_dedicated_handling_of_exports

        Show
        jira-bot ASF subversion and git services added a comment - Commit 1ef6a88f2867e54eb574ef76a0b92c79b10be3e8 in incubator-slider's branch refs/heads/feature/ SLIDER-481 _allow_dedicated_handling_of_exports from Sumit Mohanty [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=1ef6a88 ] Merge branch 'develop' into feature/ SLIDER-481 _allow_dedicated_handling_of_exports
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 34e44871efd17f0622fa55f94185f133b1a76a19 in incubator-slider's branch refs/heads/feature/SLIDER-481_allow_dedicated_handling_of_exports from Sumit Mohanty
        [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=34e4487 ]

        Merge branch 'develop' into feature/SLIDER-481_allow_dedicated_handling_of_exports

        Show
        jira-bot ASF subversion and git services added a comment - Commit 34e44871efd17f0622fa55f94185f133b1a76a19 in incubator-slider's branch refs/heads/feature/ SLIDER-481 _allow_dedicated_handling_of_exports from Sumit Mohanty [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=34e4487 ] Merge branch 'develop' into feature/ SLIDER-481 _allow_dedicated_handling_of_exports
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 31e058531a41d5169ee74b72a060af39a03a30a0 in incubator-slider's branch refs/heads/feature/SLIDER-481_allow_dedicated_handling_of_exports from Sumit Mohanty
        [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=31e0585 ]

        SLIDER-481. Exports should allow a multiple line items per export and a more hierarchical structure

        Show
        jira-bot ASF subversion and git services added a comment - Commit 31e058531a41d5169ee74b72a060af39a03a30a0 in incubator-slider's branch refs/heads/feature/ SLIDER-481 _allow_dedicated_handling_of_exports from Sumit Mohanty [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=31e0585 ] SLIDER-481 . Exports should allow a multiple line items per export and a more hierarchical structure
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit b71fb2a35d5814a2c15212585abdbd4e0803156c in incubator-slider's branch refs/heads/feature/SLIDER-481_allow_dedicated_handling_of_exports from Sumit Mohanty
        [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=b71fb2a ]

        Merge branch 'develop' into feature/SLIDER-481_allow_dedicated_handling_of_exports

        Show
        jira-bot ASF subversion and git services added a comment - Commit b71fb2a35d5814a2c15212585abdbd4e0803156c in incubator-slider's branch refs/heads/feature/ SLIDER-481 _allow_dedicated_handling_of_exports from Sumit Mohanty [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=b71fb2a ] Merge branch 'develop' into feature/ SLIDER-481 _allow_dedicated_handling_of_exports
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 1ba58cd041221c47aacca77a5ff06246fa3f2a84 in incubator-slider's branch refs/heads/develop from Sumit Mohanty
        [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=1ba58cd ]

        SLIDER-481. Exports should allow a multiple line items per export and a more hierarchical structure

        Show
        jira-bot ASF subversion and git services added a comment - Commit 1ba58cd041221c47aacca77a5ff06246fa3f2a84 in incubator-slider's branch refs/heads/develop from Sumit Mohanty [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=1ba58cd ] SLIDER-481 . Exports should allow a multiple line items per export and a more hierarchical structure
        Hide
        jira-bot ASF subversion and git services added a comment -

        Commit 63b08d116befaf0b6e83d3723d1019b0f2b6de18 in incubator-slider's branch refs/heads/develop from Steve Loughran
        [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=63b08d1 ]

        SLIDER-481 giving registry log messages meaningful text

        Show
        jira-bot ASF subversion and git services added a comment - Commit 63b08d116befaf0b6e83d3723d1019b0f2b6de18 in incubator-slider's branch refs/heads/develop from Steve Loughran [ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=63b08d1 ] SLIDER-481 giving registry log messages meaningful text

          People

          • Assignee:
            sumitmohanty Sumit Mohanty
            Reporter:
            sumitmohanty Sumit Mohanty
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development

                Agile