Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17481 LLAP workload management
  3. HIVE-18170

User mapping not initialized correctly on start

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • None
    • None

    Description

      User mapping throws NPE as it is not initialized during HS2 start.
      Initial RP is notified in WM c'tor but wm thread has not started yet resulting in NPE accessing user-pool mapping.

      java.lang.NullPointerException
      	at org.apache.hadoop.hive.ql.exec.tez.WorkloadManager.isManaged(WorkloadManager.java:1866) ~[hive-exec-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at org.apache.hadoop.hive.ql.exec.tez.WorkloadManagerFederation.getSession(WorkloadManagerFederation.java:43) ~[hive-exec-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:169) ~[hive-exec-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:205) ~[hive-exec-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) ~[hive-exec-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2230) ~[hive-exec-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1882) ~[hive-exec-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1613) ~[hive-exec-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1358) ~[hive-exec-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1351) ~[hive-exec-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:252) ~[hive-service-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at org.apache.hive.service.cli.operation.SQLOperation.access$700(SQLOperation.java:91) ~[hive-service-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:344) ~[hive-service-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_121]
      	at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_121]
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1807) ~[hadoop-common-2.8.1.jar:?]
      	at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:357) ~[hive-service-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_121]
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_121]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_121]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_121]
      	at java.lang.Thread.run(Thread.java:745) [?:1.8.0_121]
      

      Attachments

        1. HIVE-18170.4.patch
          8 kB
          Prasanth Jayachandran
        2. HIVE-18170.3.patch
          8 kB
          Prasanth Jayachandran
        3. HIVE-18170.2.patch
          3 kB
          Prasanth Jayachandran
        4. HIVE-18170.1.patch
          1 kB
          Prasanth Jayachandran

        Activity

          People

            prasanth_j Prasanth Jayachandran
            prasanth_j Prasanth Jayachandran
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: