Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12717

NPE when trying to rename a directory in Windows Azure Storage FileSystem

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.7.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Encountered an NPE when trying to use the HBase utility ExportSnapshot with Azure as the target.

      It turns out verifyAndConvertToStandardFormat is returning null when determining the hbaseRoot, and this is being added to the atomicRenameDirs set.

      java.lang.NullPointerException
      at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.isKeyForDirectorySet(AzureNativeFileSystemStore.java:1059)
      at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.isAtomicRenameKey(AzureNativeFileSystemStore.java:1053)
      at org.apache.hadoop.fs.azure.NativeAzureFileSystem.prepareAtomicFolderRename(NativeAzureFileSystem.java:2098)
      at org.apache.hadoop.fs.azure.NativeAzureFileSystem.rename(NativeAzureFileSystem.java:1996)
      at org.apache.hadoop.hbase.snapshot.ExportSnapshot.run(ExportSnapshot.java:944)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      at com.yammer.calmie.snapshot.AbstractSnapshotUtil.exportSnapshot(AbstractSnapshotUtil.java:210)
      at com.yammer.calmie.snapshot.AbstractSnapshotUtil.run(AbstractSnapshotUtil.java:79)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
      at com.yammer.calmie.snapshot.SnapshotAzureBlobUtil.main(SnapshotAzureBlobUtil.java:85)

        Attachments

        1. diff.txt
          1.0 kB
          Robert Yokota
        2. HADOOP-12717.001.patch
          1.0 kB
          Chris Nauroth
        3. HADOOP-12717.004.patch
          3 kB
          Chris Nauroth
        4. HADOOP-12717.02.patch
          3 kB
          Gaurav Kanade
        5. HADOOP-12717.03.patch
          3 kB
          Gaurav Kanade

          Activity

            People

            • Assignee:
              rayokota Robert Yokota
              Reporter:
              rayokota Robert Yokota
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: