[STORM-2436] Custom Log4j2 appender not working with storm

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Won't Fix
• Affects Version/s: 0.10.0
• Environment: Storm Mapr Cluster
• Flags: Important
• Assignee: Unassigned
• Reporter: Nishant Malhotra
• Created: 29/Mar/17 09:07
• Updated: 14/Feb/18 04:33
• Resolved: 14/Feb/18 04:33

Description

We have created below logger configuration in worker.xml of storm cluster

<!-- This is new appender we want to add -->
<FDPRollingFile name="RollingFileInfo" filename="${sys:storm.log.dir}/userlogs/info-${sys:logfile.name}"
filepattern="${sys:storm.log.dir}/userlogs/info-${sys:logfile.name}.%d

{yyyy-MM-dd-HH-mm}" append="true">
<PatternLayout>
<pattern>${patternFdpNew}</pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB"/> <!-- Or every 100 MB -->
</Policies>
</FDPRollingFile>
<FDPRollingFile name="RollingFileDebug" filename="${sys:storm.log.dir}/userlogs/debug-${sys:logfile.name}"
filepattern="${sys:storm.log.dir}/userlogs/debug-${sys:logfile.name}.%d{yyyy-MM-dd-HH-mm}

" append="true">
<PatternLayout>
<pattern>${patternFdpNew}</pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB"/> <!-- Or every 100 MB -->
</Policies>
</FDPRollingFile>
<FDPRollingFile name="RollingFileError" filename="${sys:storm.log.dir}/userlogs/error-${sys:logfile.name}"
filepattern="${sys:storm.log.dir}/userlogs/error-${sys:logfile.name}.%d

{yyyy-MM-dd-HH-mm}" append="true">
<PatternLayout>
<pattern>${patternFdpNew}</pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB"/> <!-- Or every 100 MB -->
</Policies>
</FDPRollingFile>
<!-- This is new appender we want to add -->



We have created below logger configuration in worker.xml of storm cluster

<!-- This is new appender we want to add -->
<FDPRollingFile name="RollingFileInfo" filename="${sys:storm.log.dir}/userlogs/info-${sys:logfile.name}"
filepattern="${sys:storm.log.dir}/userlogs/info-${sys:logfile.name}.%d{yyyy-MM-dd-HH-mm}

" append="true">
<PatternLayout>
<pattern>${patternFdpNew}</pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB"/> <!-- Or every 100 MB -->
</Policies>
</FDPRollingFile>
<FDPRollingFile name="RollingFileDebug" filename="${sys:storm.log.dir}/userlogs/debug-${sys:logfile.name}"
filepattern="${sys:storm.log.dir}/userlogs/debug-${sys:logfile.name}.%d

{yyyy-MM-dd-HH-mm}" append="true">
<PatternLayout>
<pattern>${patternFdpNew}</pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB"/> <!-- Or every 100 MB -->
</Policies>
</FDPRollingFile>
<FDPRollingFile name="RollingFileError" filename="${sys:storm.log.dir}/userlogs/error-${sys:logfile.name}"
filepattern="${sys:storm.log.dir}/userlogs/error-${sys:logfile.name}.%d{yyyy-MM-dd-HH-mm}

" append="true">
<PatternLayout>
<pattern>${patternFdpNew}</pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB"/> <!-- Or every 100 MB -->
</Policies>
</FDPRollingFile>
<!-- This is new appender we want to add -->
and custom logger defined in below fashion

<Logger name="custom-logger" additivity="false" level="INFO">
<appender-ref ref="RollingFileDebug" level="TRACE"/>
<appender-ref ref="RollingFileError" level="WARN"/>
<appender-ref ref="RollingFileInfo" level="INFO"/>
</Logger>

In storm topology builder main class

config.put("topology.classpath","/usr/local/Cellar/storm/mylogger.jar");
and

In spout

private static org.slf4j.Logger _logger =LoggerFactory.getLogger("custom- logger");

Now what happens it detect my jar and write one line of log in log file but post that doesn't log any line to the log file.