Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17999

Add getPreferredLocations for KafkaSourceRDD

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.2, 2.1.0
    • Component/s: Structured Streaming
    • Labels:
      None

      Description

      The newly implemented Structured Streaming KafkaSource did calculate the preferred locations for each topic partition, but didn't offer this information through RDD's getPreferredLocations method. So here propose to add this method in KafkaSourceRDD.

        Attachments

          Activity

            People

            • Assignee:
              jerryshao Saisai Shao
              Reporter:
              jerryshao Saisai Shao
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: