Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13331

AES support for over-the-wire encryption


    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.2.0
    • Component/s: Deploy
    • Labels:


      In network/common, SASL with DIGEST­-MD5 authentication is used for negotiating a secure communication channel. When SASL operation mode is "auth­-conf", the data transferred on the network is encrypted. DIGEST-MD5 mechanism supports following encryption: 3DES, DES, and RC4. The negotiation procedure will select one of them to encrypt / decrypt the data on the channel.

      However, 3des and rc4 are slow relatively. We could add code in the negotiation to make it support AES for more secure and performance.

      The proposed solution is:
      When "auth-conf" is enabled, at the end of original negotiation, the authentication succeeds and a secure channel is built. We could add one more negotiation step: Client and server negotiate whether they both support AES. If yes, the Key and IV used by AES will be generated by server and sent to client through the already secure channel. Then update the encryption / decryption handler to AES at both client and server side. Following data transfer will use AES instead of original encryption algorithm.




            • Assignee:
              junjie Junjie Chen
              dongc Dong Chen
            • Votes:
              0 Vote for this issue
              10 Start watching this issue


              • Created: