Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-7235

Improve Storage Support using Resource Provider and CSI

    XMLWordPrintableJSON

Details

    • Epic
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.5.0
    • None
    • Resource Provider and CSI

    Description

      Currently, Mesos supports both local persistent volumes as well as external persistent volumes. However, both of them are not ideal.

      Local persistent volumes do not support offering physical or logical block devices directly. Also, frameworks do not have choices to select filesystems for their local persistent volumes. There are also some usability problem with the local persistent volumes. Mesos does support multiple local disks. However, it’s a big burden for operators to configure each agent properly to be able to leverage this feature.

      External persistent volumes support in Mesos currently bypasses the resource management part. In other words, using an external persistent volume does not go through the usual offer cycle. Mesos doesn’t track resources associated with the external volumes. This makes quota control, reservation, fair sharing almost impossible to implement. Also, the current interface Mesos uses to interact with volume providers is the Docker Volume Driver interface (DVDI), which is very specific to operations on a particular agent.

      The main problem I see currently is that we don’t have a coherent story for storage. Yes, we have some primitives in Mesos that can support some stateful services, but this is far from ideal. Some of them are just the stop gap solution (e.g., the external volume support). This epic tries to tell a coherent story for supporting storage in Mesos.

      Attachments

        Issue Links

          blocks

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MESOS-8371 Support External Storage using CSI and External Resource Provider

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. MESOS-6384 Support for size with create-on-demand volumes with Docker containerizer

          • Major - Major loss of function.
          • Open
          is duplicated by

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MESOS-8030 A resource provider for supporting local storage through CSI

          • Major - Major loss of function.
          • Resolved
          is related to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MESOS-7289 Support Container Storage Interface (CSI)

          • Major - Major loss of function.
          • Resolved
          relates to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MESOS-7302 Support launching standalone containers.

          • Major - Major loss of function.
          • Resolved

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MESOS-2728 Introduce concept of cluster wide resources.

          • Major - Major loss of function.
          • Accepted

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MESOS-8374 Resource Provider and CSI Tech Debt

          • Major - Major loss of function.
          • Accepted

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MESOS-8984 Multi-host Shared Storage Support using CSI.

          • Major - Major loss of function.
          • Accepted
          links to

          Web Link CSI spec

          Activity

            People

              jieyu Jie Yu
              jieyu Jie Yu
              Votes:
              1 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: