Description
Here are re-production steps:
1. create any scala spark application which will work long enough to open the application details in Web UI
2. run spark-submit command for standalone cluster, like: --master spark:
localhost:7077
3. open running application details in Web UI, like: localhost:4040
4. spark-submit will never finish, you will have to kill the process
Cause: The application creates a thread with infinite loop for web UI communication and never stops it. The application is waiting for the thread to be finished instead, even if you close the web page.
Attachments
Issue Links
- is duplicated by
-
SPARK-18343 FileSystem$Statistics$StatisticsDataReferenceCleaner hangs on s3 write
-
- Resolved
-
- links to
