Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-16638

Reduce the number of Connection's created in classes of hbase-spark module

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      In HBaseResources.scala :

      case class RegionResource(relation: HBaseRelation) extends ReferencedResource {
        var connection: Connection = _
        var rl: RegionLocator = _
      ...
        override def init(): Unit = {
          connection = ConnectionFactory.createConnection(relation.hbaseConf)
      

      Connection is created per RegionResource.
      This is not necessary.

      Caching of Connection's should be provided to reduce the number of concurrent Connection's.

      Attachments

        1. HBASE-16638.ADDENDUM.patch
          22 kB
          Weiqing Yang
        2. HBASE-16638_v2.patch
          22 kB
          Weiqing Yang
        3. HBASE-16638_v1.patch
          22 kB
          Weiqing Yang
        4. HBASE-16638_ADDENDUM_v2.patch
          0.8 kB
          Weiqing Yang
        5. HBASE-16638_ADDENDUM_v1.patch
          14 kB
          Weiqing Yang

        Issue Links

          Activity

            People

              WeiqingYang Weiqing Yang
              yuzhihong@gmail.com Ted Yu
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: