Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-16809

Support setting CallerContext on YARN deployments

    XMLWordPrintableJSON

Details

    Description

      Now the Spark and hive have the Call Context to meet the HDFS Job Audit requirement.

      I think the flink also should to add it, and in our cluster the flink job may have big pressure to the HDFS, it's will be helpful to find the root job.

       

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-12254 Improve logging with yarn/hdfs

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. HDFS-9184 Logging HDFS operation's caller context into audit logs

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-15857 Add Caller Context in Spark

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. YARN-4349 Support CallerContext in YARN

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-25029 Hadoop Caller Context Setting In Flink

          • Major - Major loss of function.
          • Open
          links to

          Web Link GitHub Pull Request #14197

          Activity

            People

              Unassigned Unassigned
              zhuqi Qi Zhu
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: