Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-35456

Many tests fails on AZP as NPE related to FileMerging

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 1.20.0
    • 1.20.0
    • Build System / CI
    • None

    Description

      May 25 02:12:16 Caused by: java.lang.NullPointerException
      May 25 02:12:16 	at org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManagerBase.isManagedByFileMergingManager(FileMergingSnapshotManagerBase.java:733)
      May 25 02:12:16 	at org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManagerBase.lambda$null$4(FileMergingSnapshotManagerBase.java:687)
      May 25 02:12:16 	at java.util.HashMap.computeIfAbsent(HashMap.java:1127)
      May 25 02:12:16 	at org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManagerBase.lambda$restoreStateHandles$5(FileMergingSnapshotManagerBase.java:683)
      May 25 02:12:16 	at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
      May 25 02:12:16 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
      May 25 02:12:16 	at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)
      May 25 02:12:16 	at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
      May 25 02:12:16 	at java.util.stream.Streams$StreamBuilderImpl.forEachRemaining(Streams.java:419)
      May 25 02:12:16 	at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647)
      May 25 02:12:16 	at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:272)
      May 25 02:12:16 	at java.util.ArrayList$Itr.forEachRemaining(ArrayList.java:901)
      May 25 02:12:16 	at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
      May 25 02:12:16 	at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742)
      May 25 02:12:16 	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
      May 25 02:12:16 	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
      May 25 02:12:16 	at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
      May 25 02:12:16 	at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
      May 25 02:12:16 	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
      May 25 02:12:16 	at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
      May 25 02:12:16 	at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:272)
      May 25 02:12:16 	at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
      May 25 02:12:16 	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
      May 25 02:12:16 	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
      May 25 02:12:16 	at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
      May 25 02:12:16 	at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
      May 25 02:12:16 	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
      May 25 02:12:16 	at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
      May 25 02:12:16 	at org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManagerBase.restoreStateHandles(FileMergingSnapshotManagerBase.java:680)
      May 25 02:12:16 	at org.apache.flink.runtime.checkpoint.filemerging.SubtaskFileMergingManagerRestoreOperation.restore(SubtaskFileMergingManagerRestoreOperation.java:102)
      May 25 02:12:16 	at org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.registerRestoredStateToFileMergingManager(StreamTaskStateInitializerImpl.java:353)
      

      https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=59821&view=logs&j=a9db68b9-a7e0-54b6-0f98-010e0aff39e2&t=cdd32e0b-6047-565b-c58f-14054472f1be&l=12158

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            Weijie Guo Weijie Guo
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment