[FLINK-8981] Add end-to-end test for running on YARN with Kerberos

• Type: Sub-task
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.5.0
• Fix Version/s: 1.6.0
• Component/s: Deployment / YARN, Tests
• Labels: pull-request-available
• Assignee: Aljoscha Krettek
• Reporter: Till Rohrmann
• Created: 16/Mar/18 11:13
• Updated: 28/Feb/19 11:31
• Resolved: 26/Jul/18 11:23

Description

We should add an end-to-end test which verifies Flink's integration with Kerberos security. In order to do this, we should start a Kerberos secured Hadoop, ZooKeeper and Kafka cluster. Then we should start a Flink cluster with HA enabled and run a job which reads from and writes to Kafka. We could use a simple pipe job for that purpose which has some state for checkpointing to HDFS.

See security docs for how more information about Flink's Kerberos integration.

Issue Links

• links to: GitHub Pull Request #6377
• links to: GitHub Pull Request #6377