Uploaded image for project: 'Metron'
  1. Metron
  2. METRON-2088 Support HDP 3.1.0
  3. METRON-2175

Introduce HBase Connection Abstractions for HBase 2.0.2

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Done
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      The major change with HBase in migrating Metron to 2.0.2 is that connection management must now be managed by the client.  Previously this was managed internally within the HBase client.

      More specifically, previously you could just instantiate a Table whenever you like and not worry about closing it.  Now you must first establish a Connection and from that Connection, you can create a Table. Both of those need to be closed after use.  A Connection can be shared by multiple threads, but a Table cannot be shared.

      Most of our existing abstractions were not designed to handle connection management, specifically closing the Connection and Table resources after use.  This is why the HBase upgrade is quite involved.

      This Jira will introduce the new abstractions that allow Metron to interact with HBase 2.0.2, but not remove the existing ones.  I will then introduce additional issues to start using these new abstractions in the Metron code base.  Finally, the existing abstractions that do not work with HBase 2.0.2 will be removed as a final step.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                nickwallen Nick Allen
                Reporter:
                nickwallen Nick Allen
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 10m
                  2h 10m