Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8914

HDFSCleanup thread holds reference to FileSystem

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.13.1
    • Fix Version/s: 1.1.0
    • Component/s: WebHCat
    • Labels:
      None

      Description

      WebHCat server has a long running cleanup thread (HDFSCleanup) which holds a reference to FileSystem. Because of this reference, many FileSystem related objects (e.g. MetricsSystemImpl) cannot be garbage collected. Sometimes this causes OOM exception. Since the cleanup is done every 12 hours by default, we can simply recreate a FileSystem when we need to use it.

        Attachments

        1. HIVE-8914.patch
          1 kB
          shanyu zhao
        2. HIVE-8194.1.patch
          1 kB
          shanyu zhao

          Activity

            People

            • Assignee:
              shanyu shanyu zhao
              Reporter:
              shanyu shanyu zhao
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: