Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5246

Local task for map join submitted via oozie job fails on a secure HDFS

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.10.0, 0.11.0
    • 0.12.0
    • None
    • None

    Description

      For a Hive query started by Oozie Hive action, the local task submitted for Mapjoin fails. The HDFS delegation token is not shared properly with the child JVM created for the local task.

      Oozie creates a delegation token for the Hive action and sets env variable HADOOP_TOKEN_FILE_LOCATION as well as mapreduce.job.credentials.binary config property. However this doesn't get passed down to the child JVM which causes the problem.
      This is similar issue addressed by HIVE-4343 which address the problem HiveServer2

      Attachments

        1. HIVE-5246-test.tar
          10 kB
          Prasad Suresh Mujumdar
        2. HIVE-5246.1.patch
          3 kB
          Prasad Suresh Mujumdar

        Activity

          People

            prasadm Prasad Suresh Mujumdar
            prasadm Prasad Suresh Mujumdar
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: