Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-2073

Fetcher cache file verification, updating and invalidation

    XMLWordPrintableJSON

    Details

    • Type: Epic
    • Status: Accepted
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: agent, fetcher
    • Labels:
    • Epic Name:
      Fetcher cache checksums
    • Sprint:
      Mesosphere Sprint 10, Mesosphere Sprint 11

      Description

      The other tickets in the fetcher cache epic do not necessitate a check sum (e.g. MD5, SHA*) for files cached by the fetcher. Whereas such a check sum could be used to verify whether the file arrived without unintended alterations, it can first and foremost be employed to detect and trigger updates.

      Scenario: If a UIR is requested for fetching and the indicated download has the same check sum as the cached file, then the cache file will be used and the download forgone. If the check sum is different, then fetching proceeds and the cached file gets replaced.

      This capability will be indicated by an additional field in the URI protobuf. Details TBD, i.e. to be discussed in comments below.

      In addition to the above, even if the check sum is the same, we can support voluntary cache file invalidation: a fresh download can be requested, or the caching behavior can be revoked entirely.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              bernd-mesos Bernd Mathiske
              Shepherd:
              Benjamin Hindman
            • Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 96h
                96h
                Remaining:
                Remaining Estimate - 96h
                96h
                Logged:
                Time Spent - Not Specified
                Not Specified