Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14541

TestHFileOutputFormat.testMRIncrementalLoadWithSplit failed due to too many splits and few retries

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0, 1.3.0, 2.0.0
    • Component/s: HFile, test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This one seems worth a dig. We seem to be making progress but here is what we are trying to load which seems weird:

      2015-10-01 17:19:41,322 INFO  [main] mapreduce.LoadIncrementalHFiles(360): Split occured while grouping HFiles, retry attempt 10 with 4 files remaining to group or split
      2015-10-01 17:19:41,323 ERROR [main] mapreduce.LoadIncrementalHFiles(402): -------------------------------------------------
      Bulk load aborted with some files not yet loaded:
      -------------------------------------------------
        hdfs://localhost:39540/user/jenkins/test-data/720ae36a-2495-456b-ba68-19e260685a35/testLocalMRIncrementalLoad/info-B/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/ce11cbe2490d444d8958264004286aff.bottom
        hdfs://localhost:39540/user/jenkins/test-data/720ae36a-2495-456b-ba68-19e260685a35/testLocalMRIncrementalLoad/info-B/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/ce11cbe2490d444d8958264004286aff.top
        hdfs://localhost:39540/user/jenkins/test-data/720ae36a-2495-456b-ba68-19e260685a35/testLocalMRIncrementalLoad/info-A/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/30c58eeb23a6464da21117e6e1bc565c.bottom
        hdfs://localhost:39540/user/jenkins/test-data/720ae36a-2495-456b-ba68-19e260685a35/testLocalMRIncrementalLoad/info-A/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/30c58eeb23a6464da21117e6e1bc565c.top
      

      Whats that about?

      Making note here. Will keep an eye on this one.

        Attachments

        1. HBASE-14541-test.patch
          2 kB
          Matteo Bertozzi
        2. HBASE-14541-v0.patch
          3 kB
          Matteo Bertozzi
        3. HBASE-14541-v0.patch
          3 kB
          stack

          Issue Links

            Activity

              People

              • Assignee:
                mbertozzi Matteo Bertozzi
                Reporter:
                stack stack
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: