Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12708

Hive on Spark doesn't work with Kerboresed HBase [Spark Branch]

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0, 1.1.0, 2.0.0
    • Fix Version/s: spark-branch, 2.1.0
    • Component/s: Spark
    • Labels:
      None

      Description

      Spark application launcher (spark-submit) acquires HBase delegation token on Hive user's behalf when the application is launched. This mechanism, which doesn't work for long-running sessions, is not in line with what Hive is doing. Hive actually acquires the token automatically whenever a job needs it. The right approach for Spark should be allowing applications to dynamically add whatever tokens they need to the spark context. While this needs work on Spark side, we provide a workaround solution in Hive.

        Attachments

        1. HIVE-12708.1-spark.patch
          2 kB
          Xuefu Zhang
        2. HIVE-12708.1-spark.patch
          2 kB
          Xuefu Zhang

          Activity

            People

            • Assignee:
              xuefuz Xuefu Zhang
              Reporter:
              xuefuz Xuefu Zhang
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: