Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22634

Update Bouncy castle dependency

    XMLWordPrintableJSON

    Details

      Description

      Spark's usage of jets3t library as well as Spark's own Flume and Kafka streaming uses bouncy castle version 1.51
      This is an outdated version as the latest one is 1.58
      This, in turn renders packages such as spark-hadoopcryptoledger-ds unusable since these require 1.58 and spark's distributions come along with 1.51
      My own attempt was to run on EMR, and since I automatically get all of spark's dependecies (bouncy castle 1.51 being one of them) into the classpath, using the library to parse blockchain data failed due to missing functionality.

      I have also opened an issue with jets3t to update their dependecy as well, but along with that Spark would have to update it's own or at least be packaged with a newer version

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                srowen Sean Owen
                Reporter:
                lioron Lior Regev
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: