[MESOS-6668] can't fetch uris

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Not A Problem
• Affects Version/s: 1.1.0
• Component/s: fetcher
• Assignee: haosdent
• Reporter: pwzgorilla
• Created: 02/Dec/16 03:47
• Updated: 05/Dec/16 14:24
• Resolved: 05/Dec/16 14:24

Description

when with two uris: "https://nginx.org/download/nginx-1.6.3.tar.gz" "https://nginx.org/download/nginx-1.8.1.tar.gz", sometimes it will be successful fetched, but most of time failed!

I1202 11:38:37.758714 1959038976 fetcher.cpp:498] Fetcher Info: {"cache_directory":"\/tmp\/mesos\/fetch\/slaves\/dfad11fe-c83a-40aa-abc5-6390a7615545-S3","items":[{"action":"BYPASS_CACHE","uri":{"extract":true,"value":"https:\/\/nginx.org\/download\/nginx-1.6.3.tar.gz"}},{"action":"BYPASS_CACHE","uri":{"extract":true,"value":"https:\/\/nginx.org\/download\/nginx-1.8.1.tar.gz"}}],"sandbox_directory":"\/mesos\/slaves\/dfad11fe-c83a-40aa-abc5-6390a7615545-S3\/frameworks\/dfad11fe-c83a-40aa-abc5-6390a7615545-0039\/executors\/1480649917664199938-0.0001.defaultGroup.Unnamed\/runs\/037e56bc-8416-49c9-bc72-bb43c87a97d7"}
I1202 11:38:37.764912 1959038976 fetcher.cpp:409] Fetching URI 'https://nginx.org/download/nginx-1.6.3.tar.gz'
I1202 11:38:37.764940 1959038976 fetcher.cpp:250] Fetching directly into the sandbox directory
I1202 11:38:37.764974 1959038976 fetcher.cpp:187] Fetching URI 'https://nginx.org/download/nginx-1.6.3.tar.gz'
I1202 11:38:37.764999 1959038976 fetcher.cpp:134] Downloading resource from 'https://nginx.org/download/nginx-1.6.3.tar.gz' to '/mesos/slaves/dfad11fe-c83a-40aa-abc5-6390a7615545-S3/frameworks/dfad11fe-c83a-40aa-abc5-6390a7615545-0039/executors/1480649917664199938-0.0001.defaultGroup.Unnamed/runs/037e56bc-8416-49c9-bc72-bb43c87a97d7/nginx-1.6.3.tar.gz'
I1202 11:39:07.293943 1959038976 fetcher.cpp:84] Extracting with command: tar -C '/mesos/slaves/dfad11fe-c83a-40aa-abc5-6390a7615545-S3/frameworks/dfad11fe-c83a-40aa-abc5-6390a7615545-0039/executors/1480649917664199938-0.0001.defaultGroup.Unnamed/runs/037e56bc-8416-49c9-bc72-bb43c87a97d7' -xf '/mesos/slaves/dfad11fe-c83a-40aa-abc5-6390a7615545-S3/frameworks/dfad11fe-c83a-40aa-abc5-6390a7615545-0039/executors/1480649917664199938-0.0001.defaultGroup.Unnamed/runs/037e56bc-8416-49c9-bc72-bb43c87a97d7/nginx-1.6.3.tar.gz'
I1202 11:39:07.385437 1959038976 fetcher.cpp:92] Extracted '/mesos/slaves/dfad11fe-c83a-40aa-abc5-6390a7615545-S3/frameworks/dfad11fe-c83a-40aa-abc5-6390a7615545-0039/executors/1480649917664199938-0.0001.defaultGroup.Unnamed/runs/037e56bc-8416-49c9-bc72-bb43c87a97d7/nginx-1.6.3.tar.gz' into '/mesos/slaves/dfad11fe-c83a-40aa-abc5-6390a7615545-S3/frameworks/dfad11fe-c83a-40aa-abc5-6390a7615545-0039/executors/1480649917664199938-0.0001.defaultGroup.Unnamed/runs/037e56bc-8416-49c9-bc72-bb43c87a97d7'
I1202 11:39:07.385507 1959038976 fetcher.cpp:547] Fetched 'https://nginx.org/download/nginx-1.6.3.tar.gz' to '/mesos/slaves/dfad11fe-c83a-40aa-abc5-6390a7615545-S3/frameworks/dfad11fe-c83a-40aa-abc5-6390a7615545-0039/executors/1480649917664199938-0.0001.defaultGroup.Unnamed/runs/037e56bc-8416-49c9-bc72-bb43c87a97d7/nginx-1.6.3.tar.gz'
I1202 11:39:07.385517 1959038976 fetcher.cpp:409] Fetching URI 'https://nginx.org/download/nginx-1.8.1.tar.gz'
I1202 11:39:07.385524 1959038976 fetcher.cpp:250] Fetching directly into the sandbox directory
I1202 11:39:07.385546 1959038976 fetcher.cpp:187] Fetching URI 'https://nginx.org/download/nginx-1.8.1.tar.gz'
I1202 11:39:07.385560 1959038976 fetcher.cpp:134] Downloading resource from 'https://nginx.org/download/nginx-1.8.1.tar.gz' to '/mesos/slaves/dfad11fe-c83a-40aa-abc5-6390a7615545-S3/frameworks/dfad11fe-c83a-40aa-abc5-6390a7615545-0039/executors/1480649917664199938-0.0001.defaultGroup.Unnamed/runs/037e56bc-8416-49c9-bc72-bb43c87a97d7/nginx-1.8.1.tar.gz'

End fetcher log for container 037e56bc-8416-49c9-bc72-bb43c87a97d7
E1202 11:39:37.843308 3211264 fetcher.cpp:568] Failed to run mesos-fetcher: Failed to fetch all URIs for container '037e56bc-8416-49c9-bc72-bb43c87a97d7' with exit status: 9
E1202 11:39:37.843600 1601536 slave.cpp:4423] Container '037e56bc-8416-49c9-bc72-bb43c87a97d7' for executor '1480649917664199938-0.0001.defaultGroup.Unnamed' of framework dfad11fe-c83a-40aa-abc5-6390a7615545-0039 failed to start: Failed to fetch all URIs for container '037e56bc-8416-49c9-bc72-bb43c87a97d7' with exit status: 9
W1202 11:39:37.843725 1064960 composing.cpp:600] Attempted to destroy unknown container 037e56bc-8416-49c9-bc72-bb43c87a97d7
E1202 11:39:37.843735 1601536 slave.cpp:4529] Termination of executor '1480649917664199938-0.0001.defaultGroup.Unnamed' of framework dfad11fe-c83a-40aa-abc5-6390a7615545-0039 failed: unknown container
I1202 11:39:37.843849 1601536 slave.cpp:3634] Handling status update TASK_FAILED (UUID: e308b104-087d-4c9e-9606-c11e62dd14ad) for task 1480649917664199938-0.0001.defaultGroup.Unnamed of framework dfad11fe-c83a-40aa-abc5-6390a7615545-0039 from @0.0.0.0:0