[FLINK-22139] Flink Jobmanager & Task Manger logs are not writing to the logs files

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Information Provided
• Affects Version/s: 1.12.2
• Component/s: Deployment / Kubernetes
• Labels: auto-deprioritized-major

Environment

on kubernetes flink standalone deployment with jobmanager HA is enabled.

• Assignee: Unassigned
• Reporter: Bhagi
• Created: 07/Apr/21 09:50
• Updated: 17/Jun/21 06:53
• Resolved: 17/Jun/21 06:53

Description

Hi Team,

I am submitting the jobs and restarting the job manager and task manager pods.. Log files are generating with the name task manager and job manager.

but job manager & task manager log file size is '0', i am not sure any configuration missed..why logs are not writing to their log files..

1. 1. 1. 1. 1. Task Manager pod###
               flink@flink-taskmanager-85b6585b7-hhgl7:~$ ls -lart log/
               total 0
               rw-rr- 1 flink flink 0 Apr 7 09:35 flink--taskexecutor-0-flink-taskmanager-85b6585b7-hhgl7.log
               flink@flink-taskmanager-85b6585b7-hhgl7:~$

1. 1. 1. Jobmanager pod Logs #####
         flink@flink-jobmanager-f6db89b7f-lq4ps:~$
         rw-rr- 1 7148739 flink 0 Apr 7 06:36 flink--standalonesession-0-flink-jobmanager-f6db89b7f-gtkx5.log
         rw-rr- 1 7148739 flink 0 Apr 7 06:36 flink--standalonesession-0-flink-jobmanager-f6db89b7f-wnrfm.log
         rw-rr- 1 7148739 flink 0 Apr 7 06:37 flink--standalonesession-0-flink-jobmanager-f6db89b7f-2b2fs.log
         rw-rr- 1 7148739 flink 0 Apr 7 06:37 flink--standalonesession-0-flink-jobmanager-f6db89b7f-7kdhh.log
         rw-rr- 1 7148739 flink 0 Apr 7 09:35 flink--standalonesession-0-flink-jobmanager-f6db89b7f-twhkt.log
         drwxrwxrwx 2 7148739 flink 35 Apr 7 09:35 .
         rw-rr- 1 7148739 flink 0 Apr 7 09:35 flink--standalonesession-0-flink-jobmanager-f6db89b7f-lq4ps.log
         flink@flink-jobmanager-f6db89b7f-lq4ps:~$

I configured log4j.properties for flink

log4j.properties: |+
monitorInterval=30
rootLogger.level = INFO
rootLogger.appenderRef.file.ref = MainAppender
logger.flink.name = org.apache.flink
logger.flink.level = INFO
logger.akka.name = akka
logger.akka.level = INFO
appender.main.name = MainAppender
appender.main.type = RollingFile
appender.main.append = true
appender.main.fileName = ${sys:log.file}
appender.main.filePattern = ${sys:log.file}.%i
appender.main.layout.type = PatternLayout
appender.main.layout.pattern = %d

{yyyy-MM-dd HH:mm:ss,SSS}

%-5p %-60c %x - %m%n
appender.main.policies.type = Policies
appender.main.policies.size.type = SizeBasedTriggeringPolicy
appender.main.policies.size.size = 100MB
appender.main.policies.startup.type = OnStartupTriggeringPolicy
appender.main.strategy.type = DefaultRolloverStrategy
appender.main.strategy.max = ${env:MAX_LOG_FILE_NUMBER:-10}
logger.netty.name = org.apache.flink.shaded.akka.org.jboss.netty.channel.DefaultChannelPipeline
logger.netty.level = OFF