Uploaded image for project: 'Bahir (Retired)'
  1. Bahir (Retired)
  2. BAHIR-104

MQTT Dstream returned by the new multi topic support API is not a pairRDD

    XMLWordPrintableJSON

Details

    • Important

    Description

      The new multi topic support API added with BAHIR-89, when used in pyspark, does not return a Dstream of <topic,message> tuples.
      Example:
      In pyspark, when creating a Dstream using the new API ( mqttstream = MQTTUtils.createPairedStream(ssc, brokerUrl, topics) ) the expected contents of mqttstream should be a collections of tuples:

      (topic,message) , (topic,message) , (topic,message) , ...

      Instead, the current content is a flattened list:

      topic, message, topic, message, topic, message, ...

      that is hard to use.

      Attachments

        Issue Links

          Activity

            People

              fbeneventi Francesco Beneventi
              fbeneventi Francesco Beneventi
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: