[SAMZA-939] Job fails to start with StreamAppender when priority is set to debug

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.10.0
• Component/s: log4j
• Assignee: Unassigned
• Reporter: Arthur Vivian
• Created: 20/Apr/16 16:15
• Updated: 20/Apr/16 16:15

Description

Issue is as described in SAMZA-723, however now it seems to only happen when the priority in the log4j.xml file is set to "debug". I've tested this in several of our own jobs and hello-samza the result is that same in all.

log4j.xml used with hello-samza:

<!DOCTYPE log4j:configuration SYSTEM "log4j.dtd">
<log4j:configuration xmlns:log4j="http://jakarta.apache.org/log4j/">
  <appender name="jmx" class="org.apache.samza.logging.log4j.JmxAppender" />

  <appender name="RollingAppender" class="org.apache.log4j.DailyRollingFileAppender">
     <param name="File" value="${samza.log.dir}/${samza.container.name}.log" />
     <param name="DatePattern" value="'.'yyyy-MM-dd" />
     <layout class="org.apache.log4j.PatternLayout">
      <param name="ConversionPattern" value="%d{yyyy-MM-dd HH:mm:ss} %c{1} [%p] %m%n" />
     </layout>
  </appender>
  <appender name="StreamAppender" class="org.apache.samza.logging.log4j.StreamAppender">
   <layout class="org.apache.log4j.PatternLayout">
     <param name="ConversionPattern" value="%X{containerName} %X{jobName} %X{jobId} %d{yyyy-MM-dd HH:mm:ss} %c{1} [%p] %m%n" />
   </layout>
</appender>
  <root>
    <priority value="debug" />
    <appender-ref ref="RollingAppender"/>
    <appender-ref ref="jmx" />
    <appender-ref ref="StreamAppender"/>
  </root>
</log4j:configuration>

config used when running WikipediaFeedStreamTask:

job.factory.class=org.apache.samza.job.yarn.YarnJobFactory
job.name=wikipedia-feed

# YARN
yarn.package.path=file://${basedir}/target/${project.artifactId}-${pom.version}-dist.tar.gz

# Task
task.class=samza.examples.wikipedia.task.WikipediaFeedStreamTask
task.inputs=wikipedia.#en.wikipedia,wikipedia.#en.wiktionary,wikipedia.#en.wikinews

task.log4j.system=kafka
# Serializers
serializers.registry.json.class=org.apache.samza.serializers.JsonSerdeFactory

# Wikipedia System
systems.wikipedia.samza.factory=samza.examples.wikipedia.system.WikipediaSystemFactory
systems.wikipedia.host=irc.wikimedia.org
systems.wikipedia.port=6667

# Kafka System
systems.kafka.samza.factory=org.apache.samza.system.kafka.KafkaSystemFactory
systems.kafka.samza.msg.serde=json
systems.kafka.consumer.zookeeper.connect=localhost:2181/
systems.kafka.producer.bootstrap.servers=localhost:9092

# Job Coordinator
job.coordinator.system=kafka
job.coordinator.replication.factor=1

stderr:
java version "1.8.0_72"
Java(TM) SE Runtime Environment (build 1.8.0_72-b15)
Java HotSpot(TM) 64-Bit Server VM (build 25.72-b15, mixed mode)
Exception in thread "main" org.apache.kafka.common.errors.TimeoutException: Failed to update metadata after 60000 ms.