Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11622

completebulkload/loadIncrementalHFiles cannot specify table with namespace

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 0.98.0
    • None
    • None
    • None

    Description

      I'm using completebulkload to load 500GB of data to a table (presplitted). However, it reports the following errors:

      Looks like completebulkload didn't recognize the namespace part (namespace:table).

      Caused by: java.net.URISyntaxException: Relative path in absolute URI: grapple:vertices,37.bottom
      at java.net.URI.checkPath(URI.java:1804)
      at java.net.URI.<init>(URI.java:752)
      at org.apache.hadoop.fs.Path.initialize(Path.java:203)

      By looking at the source code of LoadIncrementalHFiles.java, it seems the temporary path created for splitting will contain ':',

      The error part should be this:
      String uniqueName = getUniqueName(table.getName());
      HColumnDescriptor familyDesc = table.getTableDescriptor().getFamily(item.family);
      Path botOut = new Path(tmpDir, uniqueName + ".bottom");
      Path topOut = new Path(tmpDir, uniqueName + ".top");
      splitStoreFile(getConf(), hfilePath, familyDesc, splitKey,
      botOut, topOut);

      uniqueName will be "namespce:table" so "new Path(...)" will fail.

      A bug?

      P.S.
      Comment from Matteo Bertozzi:

      we don't need the name to be related to the table name.
      We can replace the getUniqueName() using something like this

      String getUniqueName(TableName tableName)

      { String name = UUID.randomUUID().toString().replaceAll("-", "") + "," + regionCount.incrementAndGet(); return name; }

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              huangjs Jianshi Huang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: