Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8914

HDFSCleanup thread holds reference to FileSystem

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.13.1
    • 1.1.0
    • WebHCat
    • None

    Description

      WebHCat server has a long running cleanup thread (HDFSCleanup) which holds a reference to FileSystem. Because of this reference, many FileSystem related objects (e.g. MetricsSystemImpl) cannot be garbage collected. Sometimes this causes OOM exception. Since the cleanup is done every 12 hours by default, we can simply recreate a FileSystem when we need to use it.

      Attachments

        1. HIVE-8194.1.patch
          1 kB
          shanyu zhao
        2. HIVE-8914.patch
          1 kB
          shanyu zhao

        Activity

          People

            shanyu shanyu zhao
            shanyu shanyu zhao
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: