Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5246

Local task for map join submitted via oozie job fails on a secure HDFS

Log workAgile BoardRank to TopRank to BottomVotersStop watchingWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0, 0.11.0
    • Fix Version/s: 0.12.0
    • Component/s: None
    • Labels:
      None

      Description

      For a Hive query started by Oozie Hive action, the local task submitted for Mapjoin fails. The HDFS delegation token is not shared properly with the child JVM created for the local task.

      Oozie creates a delegation token for the Hive action and sets env variable HADOOP_TOKEN_FILE_LOCATION as well as mapreduce.job.credentials.binary config property. However this doesn't get passed down to the child JVM which causes the problem.
      This is similar issue addressed by HIVE-4343 which address the problem HiveServer2

        Attachments

        1. HIVE-5246.1.patch
          3 kB
          Prasad Suresh Mujumdar
        2. HIVE-5246-test.tar
          10 kB
          Prasad Suresh Mujumdar

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              prasadm Prasad Suresh Mujumdar Assign to me
              Reporter:
              prasadm Prasad Suresh Mujumdar

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment