Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2255

Allow EdgeManagerPlugins to handle storage/explosion of events

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Currently, storage of routed events in the AM is very inefficient. The series of patches with On Demand Routing in TEZ-776 is one approach to address this.

      This jira takes approach 2/3 mentioned in https://issues.apache.org/jira/browse/TEZ-776?focusedCommentId=14000047&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14000047 to allow for additional efficiency.

      Attachments

        1. EdgePluginChangesWithStorage.pdf
          90 kB
          Siddharth Seth
        2. TEZ-2255.1.notAPatach.txt
          45 kB
          Siddharth Seth

        Issue Links

          relates to

          Sub-task - The sub-task of the issue TEZ-2411 Offload DataMovement event creation from the AM to the tasks

          • Major - Major loss of function.
          • Open

          Activity

            People

              sseth Siddharth Seth
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: