Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-651

Provide a approach to get "owner" inside spark application

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.6.0
    • Fix Version/s: None
    • Component/s: Server
    • Labels:
      None

      Description

      When impersonation is disabled, hadoop UGI user will always be livy server user, there is no way to get actually owner user in spark application.

      This issue is to fix this problem by add a "spark.livy.owner" property to spark context. Spark application code can get this property if needed.

      Actually, we use this way to control Spark SQL permissions. We use a spark.sql.extensions to get owner and decide whether operation is allowed. Spark application is submitted to YARN using hive user, this will make Spark SQL permission modelĀ  exactly the same with hive(Sentry) permission model.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                xilangyan Jeffrey(Xilang) Yan
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 10m
                  10m