Uploaded image for project: 'Chukwa'
  1. Chukwa
  2. CHUKWA-723

Update Chukwa code to use new HBase API available in 0.94

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.6.0
    • Fix Version/s: 0.7.0
    • Component/s: Data Collection
    • Labels:
      None

      Description

      With 0.94 onwards, new HBase APIs are available, while depreciating old ones. For example, HTablePool has been depreciated and will be removed in the next release ( probably in 0.99), and HConnection is new one we should be using. Similarly, the KeyValue has been replaced with Cell APIs. We should change Chukwa code to have these new APIs.

      1. chukwa-723.patch.0
        7 kB
        Sreepathi Prasanna

        Activity

        Hide
        sree2k Sreepathi Prasanna added a comment -

        Updated the HBase Client with new APIs.

        Show
        sree2k Sreepathi Prasanna added a comment - Updated the HBase Client with new APIs.
        Hide
        sree2k Sreepathi Prasanna added a comment -

        Hello Eric,

        Can you review the patch, please?

        Show
        sree2k Sreepathi Prasanna added a comment - Hello Eric, Can you review the patch, please?
        Hide
        eyang Eric Yang added a comment -

        +1 looks good. I just committed this. Thanks Sreepathi.

        Show
        eyang Eric Yang added a comment - +1 looks good. I just committed this. Thanks Sreepathi.
        Hide
        eyang Eric Yang added a comment - - edited

        I notice that HConnection can drop data, if HBase is down and ChukwaHBaseStore may not receive exception message to be notified of HBase write error. We are adopting new API because HTablePool API is scheduled for removal in HBASE-9117. In HTablePool, exception is thrown correctly. Hence, adoption of new HBase API will need to work with HBase community that HConnection can drop data. This is related to HBASE-11306. We probably need to settle on the version of HBase that we support in Chukwa 0.7.0. If we are skipping HBase 0.96-0.98, maybe we should jump directly to 0.99.2, if HConnection to see if connection pool api has been improved.

        Show
        eyang Eric Yang added a comment - - edited I notice that HConnection can drop data, if HBase is down and ChukwaHBaseStore may not receive exception message to be notified of HBase write error. We are adopting new API because HTablePool API is scheduled for removal in HBASE-9117 . In HTablePool, exception is thrown correctly. Hence, adoption of new HBase API will need to work with HBase community that HConnection can drop data. This is related to HBASE-11306 . We probably need to settle on the version of HBase that we support in Chukwa 0.7.0. If we are skipping HBase 0.96-0.98, maybe we should jump directly to 0.99.2, if HConnection to see if connection pool api has been improved.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Chukwa-trunk #520 (See https://builds.apache.org/job/Chukwa-trunk/520/)
        CHUKWA-723. Update Chukwa code to use new HBase HConnection API. (Sreepathi Prasanna via Eric Yang) (eyang: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1650958)

        • /chukwa/trunk/CHANGES.txt
        • /chukwa/trunk/src/main/java/org/apache/hadoop/chukwa/datastore/ChukwaHBaseStore.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Chukwa-trunk #520 (See https://builds.apache.org/job/Chukwa-trunk/520/ ) CHUKWA-723 . Update Chukwa code to use new HBase HConnection API. (Sreepathi Prasanna via Eric Yang) (eyang: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1650958 ) /chukwa/trunk/CHANGES.txt /chukwa/trunk/src/main/java/org/apache/hadoop/chukwa/datastore/ChukwaHBaseStore.java

          People

          • Assignee:
            sree2k Sreepathi Prasanna
            Reporter:
            sree2k Sreepathi Prasanna
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development