Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4465

runAsSparkUser doesn't affect TaskRunner in Mesos environment at all.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 1.2.0
    • 1.2.1, 1.3.0
    • Deploy, Input/Output, Mesos
    • None

    Description

      runAsSparkUser enable classes using hadoop library to change an active user to spark User, however in Mesos environment, because the function calls before running within JNI, runAsSparkUser doesn't affect anything, and meaningless code. fix the Appropriate scope of function and remove meaningless code. That's a bug because of running program incorrectly. That's related to SPARK-3223 but setting framework user is not perfect solution in my tests.

      Attachments

        Activity

          People

            jongyoul Jongyoul Lee
            jongyoul Jongyoul Lee
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: