[DRILL-1538] Memory leak observed with TPCH queries on MapR-DB data (SF-100)

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Component/s: Execution - Flow
• Assignee: Parth Chandra
• Reporter: Abhishek Girish
• Created: 15/Oct/14 19:11
• Updated: 14/May/17 00:48
• Resolved: 12/Feb/15 23:45

Description

Possible memory leak was observed while executing TPCH queries on MapR-DB data (SF-100).

Setup - 4 nodes on MapR 3.1.1

Drill-env:
DRILL_MAX_DIRECT_MEMORY="32G"
DRILL_MAX_HEAP="16G"
export DRILL_JAVA_OPTS="-Xms1G -Xmx$DRILL_MAX_HEAP -XX:MaxDirectMemorySize=$DRILL_MAX_DIRECT_MEMORY -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=1G -ea"

1. Class unloading is disabled by default in Java 7
2. http://hg.openjdk.java.net/jdk7u/jdk7u60/hotspot/file/tip/src/share/vm/runtime/globals.hpp#l1622
   export SERVER_GC_OPTS="-XX:+CMSClassUnloadingEnabled -XX:+UseConcMarkSweepGC"
   export DRILL_JAVA_OPTS="$DRILL_JAVA_OPTS -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.client=false "
   export DRILL_LOG_DIR="/var/log/drill"

Log attached.