Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12782

ITBLL fails for me if generator does anything but 5M per maptask

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 1.0.0, 0.98.9
    • 1.0.0, 0.98.10, 1.1.0
    • integration tests
    • None
    • Reviewed

    Description

      Anyone else seeing this? If I do an ITBLL with generator doing 5M rows per maptask, all is good – verify passes. I've been running 5 servers and had one splot per server. So below works:

      HADOOP_CLASSPATH="/home/stack/conf_hbase:`/home/stack/hbase/bin/hbase classpath`" ./hadoop/bin/hadoop --config ~/conf_hadoop org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList --monkey serverKilling Generator 5 5000000 g1.tmp

      or if I double the map tasks, it works:

      HADOOP_CLASSPATH="/home/stack/conf_hbase:`/home/stack/hbase/bin/hbase classpath`" ./hadoop/bin/hadoop --config ~/conf_hadoop org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList --monkey serverKilling Generator 10 5000000 g2.tmp

      ...but if I change the 5M to 50M or 25M, Verify fails.

      Looking into it.

      Attachments

        1. 12782.unit.test.writing.txt
          8 kB
          Michael Stack
        2. 12782.unit.test.and.it.test.txt
          19 kB
          Michael Stack
        3. 12782.search.txt
          35 kB
          Michael Stack
        4. 12782.search.plus.txt
          44 kB
          Michael Stack
        5. 12782.search.plus.archive.recovered.edits.txt
          50 kB
          Michael Stack
        6. 12782.fix.txt
          0.8 kB
          Michael Stack
        7. 12782v2.txt
          61 kB
          Michael Stack
        8. 12782v2.0.98.txt
          0.8 kB
          Michael Stack
        9. 12782v3.0.98.txt
          0.9 kB
          Michael Stack
        10. 12782v3.txt
          61 kB
          Michael Stack
        11. 12782v4.txt
          61 kB
          Michael Stack
        12. 12782-0.98-addendum.txt
          1.0 kB
          Ted Yu

        Issue Links

          Activity

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: