Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-25318 Improvement of scheduler and execution for Flink OLAP
  3. FLINK-25376

Too many JM logs in flink session cluster for olap queries

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.12.7, 1.13.5, 1.14.2
    • None
    • Runtime / Coordination
    • None

    Description

      There're too many task/slot related log in jm when we submit small batch job to flink session cluster. The logs includes request slots, update task execution state and ect. In our benchmark the jm will generate a new log file in several minutes when the log file size is 500M, and some important logs will be overlapped. These logs is useful in flink stream/batch jobs, and should be changed to DEBUG level in flink olap mode.

      Attachments

        Activity

          People

            Unassigned Unassigned
            zjureel Fang Yong
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: