Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-36212

Add exception for Kafka readstream when decryption fails

    XMLWordPrintableJSON

    Details

    • Target Version/s:
    • Flags:
      Patch

      Description

      A silent failure is possible when reading from a Kafka broker under the following circumstances:

      SDF.isStreaming = True

      SDF.printSchema() => returns expected schema

      Query results are empty.

      Issue: Tsl Decryption has failed, but there is no exception or warning.

      Request: Add a warning throw an exception when decryption fails, such that developers can efficiently diagnose the readstream problem.

       

      This is my first ticket submitted. Please notify me if I should change anything in this ticket to make it more conformant to community standards. I'm still a beginner with Spark.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              spark-newbie-45978 Jon LaFlamme
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 3h
                3h
                Remaining:
                Remaining Estimate - 3h
                3h
                Logged:
                Time Spent - Not Specified
                Not Specified