Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13478

Fetching delegation tokens for Hive fails when using proxy users

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.6.0, 2.0.0
    • Fix Version/s: 1.6.4, 2.0.0
    • Component/s: YARN
    • Labels:
      None
    • Target Version/s:

      Description

      If you use spark-submit's proxy user support, the code that fetches delegation tokens for the Hive Metastore fails. It seems like the Hive library tries to connect to the Metastore as the proxy user, and it doesn't have a Kerberos TGT for that user, so it fails.

      I don't know whether the same issue exists in the HBase code, but I'll make a similar change so that both behave similarly.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vanzin Marcelo Vanzin
                Reporter:
                vanzin Marcelo Vanzin
              • Votes:
                2 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: