[SPARK-10882] Add the ability to connect to secured mqtt brokers

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 1.5.0, 1.5.1
• Component/s: Input/Output
• Labels: MQTT bulk-closed
• Assignee: Unassigned
• Reporter: Alexandre Touret
• Created: 30/Sep/15 13:42
• Updated: 21/May/19 04:33
• Resolved: 21/May/19 04:33

Description

Currently, there's no way to connect to secured MQTT brokers.
For example, I'm trying to subscribe to a MQTT topic hosted on a single RABBITMQ instance. I can't provide the credentials during the connection.

Furthermore, I saw in the source code (https://github.com/apache/spark/blob/7478c8b66d6a2b1179f20c38b49e27e37b0caec3/external/mqtt/src/main/scala/org/apache/spark/streaming/mqtt/MQTTInputDStream.scala#L50) that credentials are never initialized.

It could be nice to add this ability to spark

Regards