Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13717

TestBoundedRegionGroupingProvider#setMembershipDedups need to set HDFS diretory for WAL

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 1.1.0, 1.2.0, 2.0.0
    • 1.0.2, 1.2.0, 1.1.1, 2.0.0
    • wal
    • None
    • Reviewed

    Description

      org.apache.hadoop.hbase.wal.TestBoundedRegionGroupingProvider#setMembershipDedups() fails during testing in windows:

      java.lang.IllegalArgumentException: Pathname /C:/tmp/hbase-myuser/hbase/WALs/setMembershipDedups from hdfs://127.0.0.1:61737/C:/tmp/hbase-myuser/hbase/WALs/setMembershipDedups is not a valid DFS filename.
      	at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:197)
      	at org.apache.hadoop.hdfs.DistributedFileSystem.access$000(DistributedFileSystem.java:106)
      	at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1305)
      	at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1301)
      	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
      	at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1301)
      	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1424)
      	at org.apache.hadoop.hbase.regionserver.wal.FSHLog.<init>(FSHLog.java:477)
      	at org.apache.hadoop.hbase.wal.DefaultWALProvider.init(DefaultWALProvider.java:97)
      	at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:147)
      	at org.apache.hadoop.hbase.wal.BoundedRegionGroupingProvider.init(BoundedRegionGroupingProvider.java:56)
      	at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:147)
      	at org.apache.hadoop.hbase.wal.WALFactory.<init>(WALFactory.java:179)
      	at org.apache.hadoop.hbase.wal.TestBoundedRegionGroupingProvider.setMembershipDedups(TestBoundedRegionGroupingProvider.java:161)
      

      This is due to using the local file system path as root directory. We should set the HDFS directory as the root directory.

      Attachments

        1. HBASE-13717.patch
          1 kB
          Stephen Yuan Jiang

        Activity

          People

            syuanjiang Stephen Yuan Jiang
            syuanjiang Stephen Yuan Jiang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: