It is meaningful for out / err files to support scrolling. In particular, when you have to use stdout , writing out files continuously will eventually fill the disk. Similarly, err files will finally fill the disk when the job is keep rebooting with errors.
Recently, I saw some people asking for 'taskmanager.out rolling' in the community email. We happened to have done this, hoping to help those in need.
The following is our implementation:
a) Redirect stdout/stderr to logger .
b) Flinkonyarn/Flinkonk8s/standalone support stdout/stderr redirection。
c) Provide the default log4J configuration.