Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2569

increase default heap space

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Trivial
    • Resolution: Unresolved
    • Affects Version/s: 1.5.1
    • Fix Version/s: None
    • Component/s: Configuration
    • Labels:
    • Release Note:
      increase default heap space up to 256Mb (used to be 20Mb)

      Description

      flume-env.sh starts the JVM with 20 Mb heap space
      Google GCS connector opens a 64 Mo buffer resulting in an java.lang.OutOfMemoryError: Java heap space

      As discussed on the ML (http://mail-archives.apache.org/mod_mbox/flume-user/201412.mbox/%3C1417683457752.81d164d5@Nodemailer%3E), we should increase default heap space.

      • what would be a good value for heap space ? for people using GCS connector, we need more than 64Mb, but others have different needs
      • maybe passing a value to flume-ng as an option would be a good idea
      • or we could detect if a JAVA_OPTS var already exists

      I can submit easyly a pach that bumps the heap space up to 512 Mb for instance, but I think we should discuss some options.
      What do you think ?

        Attachments

        1. bumpHeapSpace.patch
          0.3 kB
          Jean-Philippe Caruana
        2. overrideXmxOption.patch
          0.3 kB
          Jean-Philippe Caruana

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                jpcaruana Jean-Philippe Caruana
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: