Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-16973

Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0
    • None

    Description

      Had a report from a user that Kerberos+AccumuloStorageHandler+HS2 was broken. Looking into it, it seems like the bit-rot got pretty bad. You'll see something like the following:

      Caused by: java.io.IOException: Failed to unwrap AuthenticationToken 
      at org.apache.hadoop.hive.accumulo.HiveAccumuloHelper.unwrapAuthenticationToken(HiveAccumuloHelper.java:312) 
      at org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getSplits(HiveAccumuloTableInputFormat.java:122) 
      

      It appears that some of the code-paths changed since when I first did my testing (or I just did poor testing) and the delegation token was never being fetched/serialized. There also are some issues with fetching the delegation token from Accumulo properly which were addressed in ACCUMULO-4665

      I believe it would also be best to just update the dependency to use Accumulo 1.7 (drop 1.6 support) as it's lacking in this regard. These changes would otherwise get much more complicated with reflection – Accumulo has moved on past 1.6, so let's do the same in Hive.

      Attachments

        1. HIVE-16973.001.patch
          85 kB
          Josh Elser
        2. HIVE-16973.002.branch-2.patch
          89 kB
          Josh Elser
        3. HIVE-16973.003.branch-2.patch
          88 kB
          Josh Elser
        4. HIVE-16973.004.branch-2.patch
          88 kB
          Josh Elser
        5. HIVE-16973.004-branch-2.patch
          88 kB
          Josh Elser
        6. HIVE-16973.004-master.patch
          89 kB
          Josh Elser
        7. HIVE-16973.005-master.patch
          89 kB
          Sushanth Sowmyan
        8. HIVE-16973.006-master.patch
          88 kB
          Sushanth Sowmyan

        Issue Links

          Activity

            People

              elserj Josh Elser
              elserj Josh Elser
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: