Flume
  1. Flume
  2. FLUME-473

Master by default uses excessive virtual memory despite only having a small amount of memory resident.

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Won't Fix
    • Affects Version/s: v0.9.4
    • Fix Version/s: v0.9.5
    • Component/s: None
    • Labels:
      None
    • Environment:

      linux.

      Description

      The jvm process defaults to allowing a process to take a percentage of physical memory. In one particular case, 6GB of virtual memory is allocated although <200MB of memory is actually used by the watchdog and master java processes. For processes with low memory requirements we should set -Xmx to a reasonable value (256m?)

        Activity

        Ashish Paliwal made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Won't Fix [ 2 ]
        Jonathan Hsieh made changes -
        Assignee Jonathan Hsieh [ jmhsieh ]
        Arvind Prabhakar made changes -
        Affects Version/s v0.9.4 [ 12317557 ]
        Eric Hauser made changes -
        Attachment watchdog_threaddump.txt [ 12497734 ]
        Eric Hauser made changes -
        Attachment watchdog_pmap.txt [ 12497733 ]
        Mark Thomas made changes -
        Project Import Tue Aug 02 16:57:12 UTC 2011 [ 1312304232406 ]
        Jonathan Hsieh made changes -
        Fix Version/s v0.9.5 [ 10090 ]
        Fix Version/s v0.9.4 [ 10050 ]
        Jonathan Hsieh made changes -
        Attachment 0001-FLUME-473-Master-by-default-uses-excessive-virtual-m.patch [ 10537 ]
        Jonathan Hsieh made changes -
        Status Open [ 1 ] Patch Available [ 10000 ]
        Jonathan Hsieh made changes -
        Status Patch Available [ 10000 ] Open [ 1 ]
        Jonathan Hsieh made changes -
        Assignee Jonathan Hsieh [ jmhsieh ]
        Jonathan Hsieh made changes -
        Status Open [ 1 ] Patch Available [ 10000 ]
        Jonathan Hsieh made changes -
        Field Original Value New Value
        Fix Version/s v0.9.4 [ 10050 ]
        Jonathan Hsieh created issue -

          People

          • Assignee:
            Unassigned
            Reporter:
            Jonathan Hsieh
          • Votes:
            3 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development