Uploaded image for project: 'Apache Apex Core'
  1. Apache Apex Core
  2. APEXCORE-474

Unifier placement during M*1 deployment

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 3.5.0
    • None
    • None

    Description

      During M*1 deployment, unifier was deployed in the separate container. But there is no advantage in doing that.

      It is better to make the unifier THREAD_LOCAL with the downstream operator.
      ( https://issues.apache.org/jira/browse/APEXCORE-482 )

      Note:

      Recently saw one Kafka ETL app, that had a total of 18 containers allocated, but out of that 5 containers were allocated for default unifiers. It also means, lots of time is spent in SerDe.

      Implementing this feature will improve the performance greatly.

      Attachments

        Activity

          People

            sandesh Sandesh Hegde
            sandesh Sandesh Hegde
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment