Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-3794

Master should not store arbitrarily sized data in ExecutorInfo.

Details

    • Improvement
    • Status: Accepted
    • Major
    • Resolution: Unresolved
    • None
    • None
    • master
    • 3

    Description

      From a comment in MESOS-3771:

      Master should not be storing the data fields from ExecutorInfo. We currently store the entire object, which means master would be at high risk of OOM-ing if a bunch of executors were started with big data blobs.

      • Master should scrub out unneeded bloat from ExecutorInfo before storing it.
      • We can use an alternate internal object, like we do for TaskInfo vs Task; see this.

      Attachments

        Issue Links

          Activity

            jamespeach James Peach added a comment -

            I have a need to pass largish blobs through ExecutorInfo. I would be happy to take this ticket if that is OK.

            jamespeach James Peach added a comment - I have a need to pass largish blobs through ExecutorInfo. I would be happy to take this ticket if that is OK.
            kaysoky Joseph Wu added a comment -

            That would be appreciated.

            kaysoky Joseph Wu added a comment - That would be appreciated.
            gilbert Gilbert Song added a comment -

            Updated this to `Improvement` as type and `Major` as priority. Please change it back if necessary.

            gilbert Gilbert Song added a comment - Updated this to `Improvement` as type and `Major` as priority. Please change it back if necessary.

            People

              Unassigned Unassigned
              kaysoky Joseph Wu
              Benjamin Mahler Benjamin Mahler
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: