Description
Spark Streaming backpressure mechanism has no initial input rate limit, receivers receive data at the maximum speed they can reach in the first batch, the data received might exhaust executors memory resources and cause out of memory exception. Eventually the streaming job would failed, the backpressure mechanism become invalid.