Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11355

When accessing data in HDFS and the key has been deleted, a Null Pointer Exception is shown.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.5.0
    • Fix Version/s: 2.7.0
    • Component/s: None
    • Labels:
      None

      Description

      When using the KMS with the file based keystore we can see this error when trying to access an encryption zone that got his key deleted:

      KMSClientProvider[http://foo.bar.com:16000/kms/v1/] has been updated.
      hdfs@foo:~$ hadoop fs -tail /user/systest/zones/n3bg0hfvyvjwvwuc/terasort/part-00000
      -tail: Fatal internal error
      java.lang.NullPointerException
              at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
              at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
              at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
              at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
              at org.apache.hadoop.util.HttpExceptionUtils.validateResponse(HttpExceptionUtils.java:157)
              at org.apache.hadoop.crypto.key.kms.KMSClientProvider.call(KMSClientProvider.java:484)
              at org.apache.hadoop.crypto.key.kms.KMSClientProvider.call(KMSClientProvider.java:442)
              at org.apache.hadoop.crypto.key.kms.KMSClientProvider.decryptEncryptedKey(KMSClientProvider.java:716)
              at org.apache.hadoop.crypto.key.KeyProviderCryptoExtension.decryptEncryptedKey(KeyProviderCryptoExtension.java:388)
              at org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(DFSClient.java:1317)
              at org.apache.hadoop.hdfs.DFSClient.createWrappedInputStream(DFSClient.java:1384)
              at org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:303)
              at org.apache.hadoop.hdfs.DistributedFileSystem$3.doCall(DistributedFileSystem.java:297)
              at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
              at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:297)
              at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:766)
              at org.apache.hadoop.fs.shell.Tail.dumpFromOffset(Tail.java:92)
              at org.apache.hadoop.fs.shell.Tail.processPath(Tail.java:73)
              at org.apache.hadoop.fs.shell.Command.processPaths(Command.java:306)
              at org.apache.hadoop.fs.shell.Command.processPathArgument(Command.java:278)
              at org.apache.hadoop.fs.shell.Command.processArgument(Command.java:260)
              at org.apache.hadoop.fs.shell.Command.processArguments(Command.java:244)
              at org.apache.hadoop.fs.shell.Command.processRawArguments(Command.java:190)
              at org.apache.hadoop.fs.shell.Command.run(Command.java:154)
              at org.apache.hadoop.fs.FsShell.run(FsShell.java:287)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
              at org.apache.hadoop.fs.FsShell.main(FsShell.java:340)
      

        Attachments

        1. HADOOP-11355.1.patch
          2 kB
          Arun Suresh

          Activity

            People

            • Assignee:
              asuresh Arun Suresh
              Reporter:
              asuresh Arun Suresh
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: