[FLINK-35828] NullArgumentException when accessing the checkpoint API concurrently

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.18.1
• Component/s: Runtime / Metrics
• Assignee: Unassigned
• Reporter: Qishang Zhong
• Created: 12/Jul/24 08:59
• Updated: 12/Jul/24 10:51

Description

2024-07-12 16:53:02,664 TRACE org.apache.flink.runtime.rest.FileUploadHandler              [] - Received request. URL:/jobs/e8eae2ce679206b9df19ec3ae07650c4/checkpoints Method:GET
2024-07-12 16:53:02,664 TRACE org.apache.flink.runtime.rest.FileUploadHandler              [] - Received request. URL:/jobs/e8eae2ce679206b9df19ec3ae07650c4/checkpoints Method:GET
2024-07-12 16:53:02,664 TRACE org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler [] - Received request /jobs/e8eae2ce679206b9df19ec3ae07650c4/checkpoints.
2024-07-12 16:53:02,664 TRACE org.apache.flink.runtime.rest.FileUploadHandler              [] - Received request. URL:/jobs/e8eae2ce679206b9df19ec3ae07650c4/checkpoints Method:GET
2024-07-12 16:53:02,664 TRACE org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler [] - Received request /jobs/e8eae2ce679206b9df19ec3ae07650c4/checkpoints.
2024-07-12 16:53:02,665 TRACE org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler [] - Starting request processing.
2024-07-12 16:53:02,665 TRACE org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler [] - Received request /jobs/e8eae2ce679206b9df19ec3ae07650c4/checkpoints.
2024-07-12 16:53:02,665 TRACE org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler [] - Starting request processing.
2024-07-12 16:53:02,665 TRACE org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler [] - Starting request processing.
2024-07-12 16:53:02,665 TRACE org.apache.flink.runtime.rest.FileUploadHandler              [] - Received request. URL:/jobs/e8eae2ce679206b9df19ec3ae07650c4/checkpoints Method:GET
2024-07-12 16:53:02,667 TRACE org.apache.flink.runtime.rest.FileUploadHandler              [] - Received request. URL:/jobs/e8eae2ce679206b9df19ec3ae07650c4/checkpoints Method:GET
2024-07-12 16:53:02,667 TRACE org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler [] - Received request /jobs/e8eae2ce679206b9df19ec3ae07650c4/checkpoints.
2024-07-12 16:53:02,667 TRACE org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler [] - Starting request processing.
2024-07-12 16:53:02,668 TRACE org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler [] - Received request /jobs/e8eae2ce679206b9df19ec3ae07650c4/checkpoints.
2024-07-12 16:53:02,668 TRACE org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler [] - Starting request processing.
2024-07-12 16:53:02,668 TRACE org.apache.flink.runtime.rest.FileUploadHandler              [] - Received request. URL:/jobs/e8eae2ce679206b9df19ec3ae07650c4/checkpoints Method:GET
2024-07-12 16:53:02,669 TRACE org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler [] - Received request /jobs/e8eae2ce679206b9df19ec3ae07650c4/checkpoints.
2024-07-12 16:53:02,669 TRACE org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler [] - Starting request processing.
2024-07-12 16:53:02,692 ERROR org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler [] - Unhandled exception.org.apache.commons.math3.exception.NullArgumentException: input array
        at org.apache.commons.math3.util.MathArrays.verifyValues(MathArrays.java:1753) ~[flink-dist_2.12-1.18.1.jar:1.18.1]
        at org.apache.commons.math3.stat.descriptive.AbstractUnivariateStatistic.test(AbstractUnivariateStatistic.java:158) ~[flink-dist_2.12-1.18.1.jar:1.18.1]
        at org.apache.commons.math3.stat.descriptive.rank.Percentile.evaluate(Percentile.java:272) ~[flink-dist_2.12-1.18.1.jar:1.18.1]
        at org.apache.commons.math3.stat.descriptive.rank.Percentile.evaluate(Percentile.java:241) ~[flink-dist_2.12-1.18.1.jar:1.18.1]
        at org.apache.flink.runtime.metrics.DescriptiveStatisticsHistogramStatistics.getPercentile(DescriptiveStatisticsHistogramStatistics.java:163) ~[flink-dist_2.12-1.18.1.jar:1.18.1]
        at org.apache.flink.runtime.metrics.DescriptiveStatisticsHistogramStatistics.getQuantile(DescriptiveStatisticsHistogramStatistics.java:57) ~[flink-dist_2.12-1.18.1.jar:1.18.1]
        at org.apache.flink.runtime.checkpoint.StatsSummarySnapshot.getQuantile(StatsSummarySnapshot.java:108) ~[flink-dist_2.12-1.18.1.jar:1.18.1]
        at org.apache.flink.runtime.rest.messages.checkpoints.StatsSummaryDto.valueOf(StatsSummaryDto.java:81) ~[flink-dist_2.12-1.18.1.jar:1.18.1]
        at org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler.createCheckpointingStatistics(CheckpointingStatisticsHandler.java:127) ~[flink-dist_2.12-1.18.1.jar:1.18.1]
        at org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler.handleCheckpointStatsRequest(CheckpointingStatisticsHandler.java:85) ~[flink-dist_2.12-1.18.1.jar:1.18.1]
        at org.apache.flink.runtime.rest.handler.job.checkpoints.CheckpointingStatisticsHandler.handleCheckpointStatsRequest(CheckpointingStatisticsHandler.java:59) ~[flink-dist_2.12-1.18.1.jar:1.18.1]
        at org.apache.flink.runtime.rest.handler.job.checkpoints.AbstractCheckpointStatsHandler.lambda(AbstractCheckpointStatsHandler.java:89) ~[flink-dist_2.12-1.18.1.jar:1.18.1]
        at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:602) [?:1.8.0_141]
        at java.util.concurrent.CompletableFuture.tryFire(CompletableFuture.java:577) [?:1.8.0_141]
        at java.util.concurrent.CompletableFuture.run(CompletableFuture.java:442) [?:1.8.0_141]
        at java.util.concurrent.Executors.call(Executors.java:511) [?:1.8.0_141]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_141]
        at java.util.concurrent.ScheduledThreadPoolExecutor.access(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_141]
        at java.util.concurrent.ScheduledThreadPoolExecutor.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_141]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_141]
        at java.util.concurrent.ThreadPoolExecutor.run(ThreadPoolExecutor.java:624) [?:1.8.0_141]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_141]

Issue Links

• relates to: FLINK-25904 NullArgumentException when accessing checkpoint stats on standby JobManager