[FLUME-2631] End to End authentication in Flume

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: Sinks+Sources
• Assignee: Johny Rufus
• Reporter: Johny Rufus
• Created: 23/Feb/15 18:32
• Updated: 01/Apr/15 22:30
• Resolved: 06/Mar/15 07:20

Description

1. The idea is to enable authentication primarily by using SASL/GSSAPI/Kerberos with Thrift RPC. [Thrift already has support for SASL api that supports kerberos, so implementing right now for Thrift. For Avro RPC kerberos support, Avro needs to support SASL first for its Netty Server, before we can use it in flume]

2. Authentication will happen hop to hop[Client to source, intermediate sources to sinks, final sink to destination].

3. As per the initial model, the user principals won’t be carried forward. The flume client[ThriftRpcClient] will authenticate itself to the KDC. All the intermediate agents [Thrift Sources/Sinks] will authenticate as principal ‘flume’ (typically, but this can be any valid principal that KDC can autenticate) to each other and the final agent will authenticate to the destination as the principal it wishes to identify to the destination