Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-14261

Memory leak in Spark Thrift Server

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.6.2, 2.0.0
    • Component/s: Spark Core
    • Labels:
      None

      Description

      I am running Spark Thrift server on Windows Server 2012. The Spark Thrift server is launched as Yarn client mode. Its memory usage is increased gradually with the queries in. I am wondering there is memory leak in Spark Thrift server.

        Attachments

        1. MemorySnapshot.PNG
          214 kB
          Xiaochun Liang
        2. 16716_heapdump_64g.PNG
          172 kB
          Xiaochun Liang
        3. 16716_heapdump_80g.PNG
          176 kB
          Xiaochun Liang
        4. 8892_4g_objects.PNG
          141 kB
          Xiaochun Liang
        5. 8892_5g_objects.PNG
          142 kB
          Xiaochun Liang
        6. 8892_6g_objects.PNG
          146 kB
          Xiaochun Liang
        7. 8892_6g_stop_longrunquery_objects.PNG
          144 kB
          Xiaochun Liang
        8. 8892_MemorySnapshot.PNG
          250 kB
          Xiaochun Liang

          Activity

            People

            • Assignee:
              olegd Oleg Danilov
              Reporter:
              xiaochun Xiaochun Liang
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: