Uploaded image for project: 'Bahir'
  1. Bahir
  2. BAHIR-104

MQTT Dstream returned by the new multi topic support API is not a pairRDD

    Details

    • Flags:
      Important

      Description

      The new multi topic support API added with BAHIR-89, when used in pyspark, does not return a Dstream of <topic,message> tuples.
      Example:
      In pyspark, when creating a Dstream using the new API ( mqttstream = MQTTUtils.createPairedStream(ssc, brokerUrl, topics) ) the expected contents of mqttstream should be a collections of tuples:

      (topic,message) , (topic,message) , (topic,message) , ...

      Instead, the current content is a flattened list:

      topic, message, topic, message, topic, message, ...

      that is hard to use.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                fbeneventi Francesco Beneventi
                Reporter:
                fbeneventi Francesco Beneventi
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: