Details
-
Improvement
-
Status: Closed
-
Minor
-
Resolution: Duplicate
-
0.9
-
None
-
None
Description
The BlobManager needed more than 2 minutes to distribute 220+ jar files to 50 TaskManagers in a user's setup.
Serving the files for all the TMs from one JM might will quickly make the network of the JM a bottleneck when distributing the files.
Potential solutions could be:
- Use a torrent-style distribution mode
- Use HDFS
Attachments
Issue Links
- is superceded by
-
FLINK-6916 FLIP-19: Improved BLOB storage architecture
- Closed