Details
-
Sub-task
-
Status: Done
-
Major
-
Resolution: Done
-
None
-
None
-
None
Description
The major change with HBase in migrating Metron to 2.0.2 is that connection management must now be managed by the client. Previously this was managed internally within the HBase client.
More specifically, previously you could just instantiate a Table whenever you like and not worry about closing it. Now you must first establish a Connection and from that Connection, you can create a Table. Both of those need to be closed after use. A Connection can be shared by multiple threads, but a Table cannot be shared.
Most of our existing abstractions were not designed to handle connection management, specifically closing the Connection and Table resources after use. This is why the HBase upgrade is quite involved.
This Jira will introduce the new abstractions that allow Metron to interact with HBase 2.0.2, but not remove the existing ones. I will then introduce additional issues to start using these new abstractions in the Metron code base. Finally, the existing abstractions that do not work with HBase 2.0.2 will be removed as a final step.
Attachments
Issue Links
- links to
