Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-5472

LoadIncrementalHFiles loops forever if the target table misses a CF

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.94.3, 0.94.4, 0.95.0
    • 0.98.0, 0.95.1
    • mapreduce
    • None
    • Reviewed

    Description

      I have some HFiles for two column families 'y','z', but I specified a target table that only has CF 'y'.
      I see the following repeated forever.
      ...
      12/02/23 22:57:37 WARN mapreduce.LoadIncrementalHFiles: Attempt to bulk load region containing into table z with files [family:y path:hdfs://bunnypig:9000/bulk/z2/y/bd6f1c3cc8b443fc9e9e5fddcdaa3b09, family:z path:hdfs://bunnypig:9000/bulk/z2/z/38f12fdbb7de40e8bf0e6489ef34365d] failed. This is recoverable and they will be retried.
      12/02/23 22:57:37 DEBUG client.MetaScanner: Scanning .META. starting at row=z,,00000000000000 for max=2147483647 rows using org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@7b7a4989
      12/02/23 22:57:37 INFO mapreduce.LoadIncrementalHFiles: Split occured while grouping HFiles, retry attempt 1596 with 2 files remaining to group or split
      12/02/23 22:57:37 INFO mapreduce.LoadIncrementalHFiles: Trying to load hfile=hdfs://bunnypig:9000/bulk/z2/y/bd6f1c3cc8b443fc9e9e5fddcdaa3b09 first=r last=r
      12/02/23 22:57:37 INFO mapreduce.LoadIncrementalHFiles: Trying to load hfile=hdfs://bunnypig:9000/bulk/z2/z/38f12fdbb7de40e8bf0e6489ef34365d first=r last=r
      12/02/23 22:57:37 DEBUG mapreduce.LoadIncrementalHFiles: Going to connect to server region=z,,1330066309814.d5fa76a38c9565f614755e34eacf8316., hostname=localhost, port=60020 for row
      ...

      Attachments

        1. HBASE-5472-trunk.patch
          2 kB
          Yu Li
        2. HBASE-5472-trunk-v2.patch
          2 kB
          Yu Li
        3. HBASE-5472-trunk-v3.patch
          4 kB
          Yu Li
        4. HBASE-5472-trunk-v4.patch
          4 kB
          Yu Li
        5. 5472v5.txt
          7 kB
          Michael Stack
        6. HBASE-5472-0.94-trunk.patch
          4 kB
          Yu Li
        7. 5472v5.txt
          7 kB
          Michael Stack
        8. 5472.txt
          1 kB
          Michael Stack
        9. HBASE-5472-trunk-v6.patch
          8 kB
          Yu Li

        Activity

          People

            liyu Yu Li
            larsh Lars Hofhansl
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: