Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2569

increase default heap space

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Trivial
    • Resolution: Unresolved
    • 1.5.1
    • None
    • Configuration
    • increase default heap space up to 256Mb (used to be 20Mb)

    Description

      flume-env.sh starts the JVM with 20 Mb heap space
      Google GCS connector opens a 64 Mo buffer resulting in an java.lang.OutOfMemoryError: Java heap space

      As discussed on the ML (http://mail-archives.apache.org/mod_mbox/flume-user/201412.mbox/%3C1417683457752.81d164d5@Nodemailer%3E), we should increase default heap space.

      • what would be a good value for heap space ? for people using GCS connector, we need more than 64Mb, but others have different needs
      • maybe passing a value to flume-ng as an option would be a good idea
      • or we could detect if a JAVA_OPTS var already exists

      I can submit easyly a pach that bumps the heap space up to 512 Mb for instance, but I think we should discuss some options.
      What do you think ?

      Attachments

        1. bumpHeapSpace.patch
          0.3 kB
          Jean-Philippe Caruana
        2. overrideXmxOption.patch
          0.3 kB
          Jean-Philippe Caruana

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. FLUME-2337 export JAVA_HOME in flume-env.sh.template and increase heap size

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              jpcaruana Jean-Philippe Caruana
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: