Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18386

Batch mode SQL source for Kafka

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • None
    • None
    • SQL
    • None

    Description

      An SQL equivalent to the DStream KafkaUtils.createRDD would be useful for querying over a defined batch of offsets.

      The possibility of Kafka 0.10.1 time indexing (e.g. a batch from timestamp X to timestamp Y) should be taken into account, even if not available in the initial implementation.

      Attachments

        Issue Links

          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. SPARK-18682 Batch Source for Kafka

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              koeninger Cody Koeninger
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: