Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3866

add ability to pass information between plugins

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Distinct from TEZ-3815, since even with a hack that makes plugins aware of each other, they cannot store task-specific info without calling into each others' per-task structures.

      In particular, I need a piece of info that is generated when the custom scheduler calls getContext().taskAllocated, to be propagated to communicator plugin registerRunningTaskAttempt, so that the custom communicator could include additional info in task submission (e.g. a scheduler-specific priority or other instructions). There doesn't seem to be any means to do it now.

      Attachments

        1. TEZ-3866.2.patch
          39 kB
          Jaume M
        2. TEZ-3866.1.patch
          38 kB
          Jaume M

        Activity

          People

            jmarhuen Jaume M
            sershe Sergey Shelukhin
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 10m
                10m