Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-3670

Kerberos: Improving long-running streaming jobs

    XMLWordPrintableJSON

Details

    Description

      We have seen in the past, that Hadoop's delegation tokens are subject to a number of subtle token renewal bugs. In addition, they have a maximum life time that can be worked around but is very inconvenient for the user.

      As per mailing list discussion, a way to work around the maximum life time of DelegationTokens would be to pass the Kerberos principal and key tab upon job submission. A daemon could then periodically renew the ticket.

      Attachments

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HDFS-9276 Failed to Update HDFS Delegation Token for long running application in HA mode

          • Major - Major loss of function.
          • Resolved
          is part of

          New Feature - A new feature of the product, which has yet to be developed. FLINK-3929 Support for Kerberos Authentication with Keytab Credential

          • Major - Major loss of function.
          • Resolved
          is related to

          New Feature - A new feature of the product, which has yet to be developed. FLINK-3239 Support for Kerberos enabled Kafka 0.9.0.0

          • Major - Major loss of function.
          • Resolved
          requires

          New Feature - A new feature of the product, which has yet to be developed. FLINK-3929 Support for Kerberos Authentication with Keytab Credential

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              vijikarthi Vijay Srinivasaraghavan
              mxm Maximilian Michels
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: