Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: 0.10.0
    • Component/s: slave
    • Labels:
      None

      Description

      Currently, there is no garbage collection of completed executors/frameworks on slaves, leading to local directories periodically filling up.

      Design proposal:

      • A libprocess process that gets messages when an executor has gotten cleaned up and sets some timeout when it should clean up the directory. Abstracting it this way is nice because we could add other capabilities like copying the directory output to HDFS if requested by the user.
      • Making sure directories continue to get cleaned up after a slave restarts
      • Make sure frameworks use their executor's working directory for storage rather than a hard-configured path (e.g. /tmp)

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        309d 4h 49m 1 Vinod Kone 13/Dec/12 01:26
        Vinod Kone made changes -
        Affects Version/s 0.9.0 [ 12319875 ]
        Vinod Kone made changes -
        Fix Version/s 0.10.0 [ 12324389 ]
        Vinod Kone made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Assignee Vinod Kone [ vinodkone ]
        Resolution Fixed [ 1 ]
        Hide
        Vinod Kone added a comment -

        This is on trunk

        Show
        Vinod Kone added a comment - This is on trunk
        Mark Thomas made changes -
        Workflow jira [ 12652411 ] Mesos workflow [ 12741048 ]
        Thomas Marshall made changes -
        Field Original Value New Value
        Assignee Thomas Marshall [ twm378 ]
        Thomas Marshall created issue -

          People

          • Assignee:
            Vinod Kone
            Reporter:
            Thomas Marshall
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Due:
              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 720h
              720h
              Remaining:
              Remaining Estimate - 720h
              720h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development