Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11368

Multi-column family BulkLoad fails if compactions go on too long

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      Compactions take a read lock. If a multi-column family region, before bulk loading, we want to take a write lock on the region. If the compaction takes too long, the bulk load fails.

      Various recipes include:
      + Making smaller regions (lame)
      + victorunique suggests major compacting just before bulk loading over in HBASE-10882 as a work around.

      Does the compaction need a read lock for that long? Does the bulk load need a full write lock when multiple column families? Can we fail more gracefully at least?

      Note: Fixed in subtask HBASE-14575

      Attachments

        1. hbase-11368-0.98.5.patch
          4 kB
          Qiang Tian
        2. performance_improvement_verification_98.5.patch
          7 kB
          Qiang Tian
        3. key_stacktrace_hbase10882.TXT
          11 kB
          Qiang Tian
        4. hbase11368-master.patch
          4 kB
          Qiang Tian

        Issue Links

          Activity

            People

              Unassigned Unassigned
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: