flume-env.sh starts the JVM with 20 Mb heap space
Google GCS connector opens a 64 Mo buffer resulting in an java.lang.OutOfMemoryError: Java heap space
As discussed on the ML (http://mail-archives.apache.org/mod_mbox/flume-user/201412.mbox/%3C1417683457752.81d164d5@Nodemailer%3E), we should increase default heap space.
- what would be a good value for heap space ? for people using GCS connector, we need more than 64Mb, but others have different needs
- maybe passing a value to flume-ng as an option would be a good idea
- or we could detect if a JAVA_OPTS var already exists
I can submit easyly a pach that bumps the heap space up to 512 Mb for instance, but I think we should discuss some options.
What do you think ?