[SPARK-32155] Provide options for offset-based semantics when using structured streaming from a file stream source

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: Structured Streaming
• Assignee: Unassigned
• Reporter: Christopher Highman
• Shepherd: Jungtaek Lim
• Created: 02/Jul/20 09:13
• Updated: 02/Jul/20 09:14

Description

Implement the following options while performing structured streaming from a file data source:

startingOffsetsByTimestamp
endingOffsetsByTimestamp
startingOffsets
endingOffsets

These options currently exist when using structured streaming from a Kafka data source. 

Please see comments from the below PR for details.
https://github.com/apache/spark/pull/28841

Example from usage with Kafka data source
http://spark.apache.org/docs/latest/structured-streaming-kafka-integration.html#creating-a-kafka-source-for-batch-queries