Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2569

increase default heap space

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Trivial
    • Resolution: Unresolved
    • Affects Version/s: 1.5.1
    • Fix Version/s: None
    • Component/s: Configuration
    • Labels:
    • Release Note:
      increase default heap space up to 256Mb (used to be 20Mb)

      Description

      flume-env.sh starts the JVM with 20 Mb heap space
      Google GCS connector opens a 64 Mo buffer resulting in an java.lang.OutOfMemoryError: Java heap space

      As discussed on the ML (http://mail-archives.apache.org/mod_mbox/flume-user/201412.mbox/%3C1417683457752.81d164d5@Nodemailer%3E), we should increase default heap space.

      • what would be a good value for heap space ? for people using GCS connector, we need more than 64Mb, but others have different needs
      • maybe passing a value to flume-ng as an option would be a good idea
      • or we could detect if a JAVA_OPTS var already exists

      I can submit easyly a pach that bumps the heap space up to 512 Mb for instance, but I think we should discuss some options.
      What do you think ?

        Attachments

        1. bumpHeapSpace.patch
          0.3 kB
          Jean-Philippe Caruana
        2. overrideXmxOption.patch
          0.3 kB
          Jean-Philippe Caruana

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jpcaruana Jean-Philippe Caruana

              Dates

              • Created:
                Updated:

                Issue deployment