[MESOS-8410] Reconfiguration policy fails to handle mount disk resources.

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Target Version/s: 1.5.0
• Story Points: 3
• Assignee: Benno Evers
• Reporter: James Peach
• Created: 06/Jan/18 01:59
• Updated: 27/Mar/18 11:35
• Resolved: 12/Jan/18 20:12

Description

We deployed --reconfiguration_policy="additive" on a number of Mesos agents that had mount disk resources configured, and it looks like the agent confused the size of the mount disk with the size of the work directory resource:

E0106 01:54:15.000123 1310889 slave.cpp:6733] EXIT with status 1: Failed to perform recovery: Configuration change not permitted under 'additive' policy: Value of scalar resource 'disk' decreased from 1830000 to 868000

The --resources flag is

--resources="[
  {
    "name": "disk",
    "type": "SCALAR",
    "scalar": {
      "value": 868000
    }
  }
  ,
  {
    "name": "disk",
    "type": "SCALAR",
    "scalar": {
      "value": 1830000
    },
    "disk": {
      "source": {
        "type": "MOUNT",
        "mount": {
          "root" : "/srv/mesos/volumes/a"
        }
      }
    }
  }
  ,
  {
    "name": "disk",
    "type": "SCALAR",
    "scalar": {
      "value": 1830000
    },
    "disk": {
      "source": {
        "type": "MOUNT",
        "mount": {
          "root" : "/srv/mesos/volumes/b"
        }
      }
    }
  }
  ,
  {
    "name": "disk",
    "type": "SCALAR",
    "scalar": {
      "value": 1830000
    },
    "disk": {
      "source": {
        "type": "MOUNT",
        "mount": {
          "root" : "/srv/mesos/volumes/c"
        }
      }
    }
  }
  ,
  {
    "name": "disk",
    "type": "SCALAR",
    "scalar": {
      "value": 1830000
    },
    "disk": {
      "source": {
        "type": "MOUNT",
        "mount": {
          "root" : "/srv/mesos/volumes/d"
        }
      }
    }
  }
  ,
  {
    "name": "disk",
    "type": "SCALAR",
    "scalar": {
      "value": 1830000
    },
    "disk": {
      "source": {
        "type": "MOUNT",
        "mount": {
          "root" : "/srv/mesos/volumes/e"
        }
      }
    }
  }
  ,
  {
    "name": "disk",
    "type": "SCALAR",
    "scalar": {
      "value": 1830000
    },
    "disk": {
      "source": {
        "type": "MOUNT",
        "mount": {
          "root" : "/srv/mesos/volumes/f"
        }
      }
    }
  }
  ,
  {
    "name": "disk",
    "type": "SCALAR",
    "scalar": {
      "value": 1830000
    },
    "disk": {
      "source": {
        "type": "MOUNT",
        "mount": {
          "root" : "/srv/mesos/volumes/g"
        }
      }
    }
  }
  ,
  {
    "name": "disk",
    "type": "SCALAR",
    "scalar": {
      "value": 1830000
    },
    "disk": {
      "source": {
        "type": "MOUNT",
        "mount": {
          "root" : "/srv/mesos/volumes/h"
        }
      }
    }
  }
]

Issue Links

• relates to: MESOS-1739 Allow slave reconfiguration on restart