Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
2.4.4
-
None
Description
In Spark documentation : https://spark.apache.org/docs/2.4.4/streaming-kinesis-integration.html#configuring-spark-streaming-application
I find that here we still give exemple like:
".initialPositionInStream([initial position])"
But in the code source of spark-streaming-kinesis-asl_2.11-2.4.4
I noticed:
@deprecated("use initialPosition(initialPosition: KinesisInitialPosition)", "2.3.0")
def initialPositionInStream(initialPosition: InitialPositionInStream): Builder
So, I think that the doc here should be updated, to give an exemple like:
".initialPosition([initial position])"
And the same thing goes to the description below:
"[initial position]: Can be either InitialPositionInStream.TRIM_HORIZON or InitialPositionInStream.LATEST"
In fact, now we can use KinesisInitialPositions.TRIM_HORIZON KinesisInitialPositions.LATEST or KinesisInitialPositions.AT_TIMESTAMP
(by using initialPosition in the place of initialPositionInStream)
Attachments
Issue Links
- links to