[SPARK-19936] Page rank example takes long time to complete

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 2.1.0
• Component/s: Block Manager, Mesos, Spark Core

Environment

CentOS 7, Mesos 1.1.0

• Assignee: Unassigned
• Reporter: Stan Teresen
• Created: 13/Mar/17 13:32
• Updated: 17/May/20 18:21
• Resolved: 15/Mar/17 08:29

Description

Sometimes Page Rank example takes very long time to finish on Mesos due to exceptions on fetching remote block in RetryingBlockFetcher on executor sides.
As it is seen in the log files attached it took ~30 min for an example to complete in AWS 3 nodes environment (1 Mesos master and 2 agents).