Details

    • Type: Epic Epic
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: v0.9.4
    • Fix Version/s: v0.9.5
    • Component/s: Master
    • Labels:
      None

      Description

      Multi master configurations for high availability and node scalability suffers from several deficiencies. This jira will serve as a coordination point for another implementation of the master's configuration storage mechanism and or a possible re-architecting of is code.

      These are some of the core issues:

      1) Translations for logical nodes (auto*Chain, logicalSource/Sink) does not work in mutli-master.
      2) Flows abstraction is not scalable.
      3) ZK-backend needs to be revisited to be scalable (single znodes vs several znodes).
      4) OOME error occurs due to ack sharing mechanism.
      5) Each master maintains its own command history.

      Fundamentally, this is due to two core issues:

      1) Not all state information is shared.
      2) Current implementation does not have a leader

        Issue Links

          Issues in Epic

          There are no issues in this epic.

            Activity

            Ashish Paliwal made changes -
            Status Reopened [ 4 ] Resolved [ 5 ]
            Fix Version/s v0.9.5 [ 12317558 ]
            Resolution Won't Fix [ 2 ]
            Alexander Alten-Lorenz made changes -
            Resolution Won't Fix [ 2 ]
            Status Resolved [ 5 ] Reopened [ 4 ]
            Alexander Alten-Lorenz made changes -
            Status Open [ 1 ] Resolved [ 5 ]
            Resolution Won't Fix [ 2 ]
            Arvind Prabhakar made changes -
            Affects Version/s v0.9.4 [ 12317557 ]
            Mark Thomas made changes -
            Project Import Tue Aug 02 16:57:12 UTC 2011 [ 1312304232406 ]
            Jonathan Hsieh made changes -
            Link This issue depends on FLUME-114 [ FLUME-114 ]
            Jonathan Hsieh made changes -
            Link This issue depends on FLUME-381 [ FLUME-381 ]
            Jonathan Hsieh made changes -
            Link This issue blocks FLUME-675 [ FLUME-675 ]
            Jonathan Hsieh made changes -
            Link This issue depends on FLUME-675 [ FLUME-675 ]
            Jonathan Hsieh made changes -
            Link This issue depends on FLUME-675 [ FLUME-675 ]
            Jonathan Hsieh made changes -
            Link This issue blocks FLUME-674 [ FLUME-674 ]
            Jonathan Hsieh made changes -
            Link This issue relates to FLUME-52 [ FLUME-52 ]
            Jonathan Hsieh made changes -
            Field Original Value New Value
            Link This issue blocks FLUME-194 [ FLUME-194 ]
            Jonathan Hsieh created issue -

              People

              • Assignee:
                Unassigned
                Reporter:
                Jonathan Hsieh
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Development