Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5246

Local task for map join submitted via oozie job fails on a secure HDFS

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0, 0.11.0
    • Fix Version/s: 0.12.0
    • Component/s: None
    • Labels:
      None

      Description

      For a Hive query started by Oozie Hive action, the local task submitted for Mapjoin fails. The HDFS delegation token is not shared properly with the child JVM created for the local task.

      Oozie creates a delegation token for the Hive action and sets env variable HADOOP_TOKEN_FILE_LOCATION as well as mapreduce.job.credentials.binary config property. However this doesn't get passed down to the child JVM which causes the problem.
      This is similar issue addressed by HIVE-4343 which address the problem HiveServer2

        Attachments

        1. HIVE-5246-test.tar
          10 kB
          Prasad Mujumdar
        2. HIVE-5246.1.patch
          3 kB
          Prasad Mujumdar

          Activity

            People

            • Assignee:
              prasadm Prasad Mujumdar
              Reporter:
              prasadm Prasad Mujumdar
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: