Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9234

HiveServer2 leaks FileSystem objects in FileSystem.CACHE

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.12.0, 0.13.0, 0.12.1, 0.14.0, 0.13.1
    • Fix Version/s: 1.0.0
    • Component/s: HiveServer2
    • Labels:
      None

      Description

      Running over extended period (48+ hrs), we've noticed HiveServer2 leaking FileSystem objects in FileSystem.CACHE. Linked jiras were previous attempts to fix it, but the issue still seems to be there. A workaround is to disable the caching (by setting fs.hdfs.impl.disable.cache and fs.file.impl.disable.cache to true), but creating new FileSystem objects is expensive.

        Attachments

        1. HIVE-9234.1.patch
          11 kB
          Vaibhav Gumashta
        2. HIVE-9234.2.patch
          11 kB
          Vaibhav Gumashta
        3. HIVE-9234.2.patch
          11 kB
          Vaibhav Gumashta
        4. HIVE-9234.branch-14.patch
          1 kB
          Vaibhav Gumashta

          Issue Links

            Activity

              People

              • Assignee:
                vgumashta Vaibhav Gumashta
                Reporter:
                vgumashta Vaibhav Gumashta
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: