Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-5362

ZK connection leak

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Invalid
    • 0.90.3
    • None
    • mapreduce
    • None

    Description

      I have an application like a scheduler that starts periodically some MR jobs that reads from one HBase table and write in more tables, changing the row key and the columns list.
      I have encounted a problem with this: after each MR job, I have +1 connections open to ZK and after a period of time, I have received IOException. I saw that I am not the first that had had this problem, but I didn't see any fix. No in HBase 0.90.4, nor in HBase 0.92.
      To fix this issue I wrote a custom TableInputFormat that forces to close the connection to ZK after each getSplits call.
      Also, the initTableMapperJob was overwritten.
      I found an open JIRA issue here: https://issues.apache.org/jira/browse/HBASE-3792

      Regards,
      Ionut I.

      Attachments

        Activity

          People

            Unassigned Unassigned
            ionignat Ionut Ignatescu
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: