A silent failure is possible when reading from a Kafka broker under the following circumstances:
SDF.isStreaming = True
SDF.printSchema() => returns expected schema
Query results are empty.
Issue: Tsl Decryption has failed, but there is no exception or warning.
Request: Add a warning throw an exception when decryption fails, such that developers can efficiently diagnose the readstream problem.
This is my first ticket submitted. Please notify me if I should change anything in this ticket to make it more conformant to community standards. I'm still a beginner with Spark.