[SPARK-10923] Spark handling parallel requests

• Type: Question
• Status: Resolved
• Priority: Trivial
• Resolution: Invalid
• Affects Version/s: 1.3.0
• Component/s: Spark Core
• Labels: parallel scala spark-submit

Environment

Cent os 6

• Assignee: Unassigned
• Reporter: Tarek Abouzeid
• Created: 05/Oct/15 08:58
• Updated: 05/Oct/15 13:14
• Resolved: 05/Oct/15 09:08

Description

Hi ,
i am using Scala , doing a socket program to catch multiple requests at same time and then call a function which uses spark to handle each process , i have a multi-threaded server to handle the multiple requests and pass each to spark , but there's a bottleneck as the spark doesn't initialize a sub task for the new request , is it even possible to do parallel processing using single spark job ?

Best Regards,