Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-651

Provide a approach to get "owner" inside spark application

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.6.0
    • 0.9.0
    • Server
    • None

    Description

      When impersonation is disabled, hadoop UGI user will always be livy server user, there is no way to get actually owner user in spark application.

      This issue is to fix this problem by add a "spark.livy.owner" property to spark context. Spark application code can get this property if needed.

      Actually, we use this way to control Spark SQL permissions. We use a spark.sql.extensions to get owner and decide whether operation is allowed. Spark application is submitted to YARN using hive user, this will make Spark SQL permission modelĀ  exactly the same with hive(Sentry) permission model.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              xilangyan Xilang Yan
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 10m
                  10m