Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-14261

Memory leak in Spark Thrift Server

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.6.0
    • 1.6.2, 2.0.0
    • Spark Core
    • None

    Description

      I am running Spark Thrift server on Windows Server 2012. The Spark Thrift server is launched as Yarn client mode. Its memory usage is increased gradually with the queries in. I am wondering there is memory leak in Spark Thrift server.

      Attachments

        1. MemorySnapshot.PNG
          214 kB
          Xiaochun Liang
        2. 8892_MemorySnapshot.PNG
          250 kB
          Xiaochun Liang
        3. 8892_6g_stop_longrunquery_objects.PNG
          144 kB
          Xiaochun Liang
        4. 8892_6g_objects.PNG
          146 kB
          Xiaochun Liang
        5. 8892_5g_objects.PNG
          142 kB
          Xiaochun Liang
        6. 8892_4g_objects.PNG
          141 kB
          Xiaochun Liang
        7. 16716_heapdump_80g.PNG
          176 kB
          Xiaochun Liang
        8. 16716_heapdump_64g.PNG
          172 kB
          Xiaochun Liang

        Activity

          People

            olegd Oleg Danilov
            xiaochun Xiaochun Liang
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: