Uploaded image for project: 'Sentry (Retired)'
  1. Sentry (Retired)
  2. SENTRY-1831

The MetastorePlugin SyncTask is leaking connection threads when read timed out issues are thrown

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Problem
    • Affects Version/s: 1.8.0
    • Fix Version/s: 2.0.0
    • Component/s: Sentry
    • Labels:
      None

      Description

      The MetastorePlugin.SyncTask class is a thread running in the background in the HMS side that is used to keep HMS/Sentry in sync with HDFS, or any other words, it pushes a full HMS snapshot to Sentry every time Sentry is out-of-sync.
      However when a timed out exception is thrown when sending the snapshot to Sentry, a retry happens in the next thread run() iteration.
      The problem is that these exceptions do not terminate the Thrift thread sending the data, and a new retry will generate a new Thrift thread be created. We should close those threads by resetting the connection when an error occurs.

        Attachments

        1. SENTRY-1831.001.patch
          0.8 kB
          Arjun Mishra

          Issue Links

            Activity

              People

              • Assignee:
                arjunmishra13 Arjun Mishra
                Reporter:
                arjunmishra13 Arjun Mishra

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Issue deployment