[SPARK-27206] Using slice method with streaming api's Interval on DStream

• Type: Question
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.4.0
• Component/s: DStreams

Environment

Linux, standalone spark

• Assignee: Unassigned
• Reporter: Aarthi
• Created: 19/Mar/19 15:51
• Updated: 20/Mar/19 13:14
• Resolved: 20/Mar/19 13:14

Description

Hi. I am in need to slice a DStream that receives data from a custom receiver (implemented with Spark's Receiver). There are two options to do this

1. slice(fromTime: Time, toTime: Time)
2. slice(interval: Interval)

Although the second option is a public method, the Interval class is private. Can you please help me understand how to use this api with org.apache.spark.streaming.Interval ?

Thanks, Aarthi