[MESOS-3367] Mesos fetcher does not extract archives for URI with parameters

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 0.22.1, 0.23.0
• Component/s: fetcher
• Labels: mesosphere

Environment

DCOS 1.1

• Assignee: haosdent
• Reporter: Renat Zubairov
• Created: 04/Sep/15 09:42
• Updated: 26/Nov/18 12:32
• Resolved: 26/Nov/18 12:32

Description

I'm deploying using marathon applications with sources served from S3. I'm using a signed URL to give only temporary access to the S3 resources, so URL of the resource have some query parameters.

So URI is 'https://foo.com/file.tgz?hasi' and fetcher stores it in the file with the name 'file.tgz?hasi', then it thinks that extension 'hasi' is not tgz hence extraction is skipped, despite the fact that MIME Type of the HTTP resource is 'application/x-tar'.

Workaround - add additional parameter like '&workaround=.tgz'

Issue Links

• is duplicated by: MESOS-4779 Strip query strings and fragments from fetcher urls.
• is related to: MESOS-8250 Fetcher cache does not ignore query parameters in URIs
• relates to: MESOS-1686 URI query strings are preserved in local filename
• relates to: MESOS-1509 Use Content-Disposition filename (if available) when downloading HTTP URIs
• relates to: MESOS-4735 CommandInfo.URI should allow specifying target filename