Uploaded image for project: 'Camel'
  1. Camel
  2. CAMEL-5824

camel-hbase - HBase data access performance improvement

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.10.2
    • 2.10.3, 2.11.0
    • camel-hbase
    • OS:CentOS6.2 64bit
      CPU:Core i7 2700
      Memory:16GB
      HDD:WD20EARX(2TB SATA600)

    • Patch Available
    • Novice

    Description

      In testing hbase client using camel-hbase component,
      data put performance is low.
      ( about 20 put operation / second, I use Core i7 2700K machine.)

      I confirmed performance bottleneck.
      And I find bottleneck below

      • Everytime camel-hbase component put data,
        camel-hbase component creates and closes HTableInterface.
      • But HTableInterface create cost is high.
        So camel-hbase component performance is low.

      Performance problem is fixed by using HTablePool at HBaseProducer,
      data put performance is improved 20 operetion/second to 200 operation/second.

      Modified source is below( and attach patchfile.txt)

      • HBaseProducer.java(orig)
        ----------------------------
        104 table.close();
        ----------------------------
      • HBaseProducer.java(improved)
        ----------------------------
        104 tablePool.putTable(table);
        ----------------------------

      Attachments

        1. patchfile.txt
          0.4 kB
          Sotaro Kimura

        Activity

          People

            njiang Willem Jiang
            skimura Sotaro Kimura
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: