Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-5585

NullPointer Exception in JobManager.updateAccumulators

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0, 1.1.4
    • Fix Version/s: 1.2.0, 1.3.0, 1.1.5
    • Component/s: JobManager
    • Labels:
      None

      Description

      NullPointerException
      
      at JobManager$$updateAccumulators$1.apply(JobManager.scala:1790)
      at JobManager$$updateAccumulators$1.apply(JobManager.scala:1788)
      at scala.collection.mutable.ResizableArray$class.forEach(ArrayBuffer.scala:48)
      at scala.collection.mutable.ArrayBuffer.forEach(ArrayBuffer.scala:48)
      at org.apache.flink.runtime.jobmanager.JobManager.org$apache$flink$runtime$jobmanager$JobManager$$updateAccumulators(JobManager.scala:1788)
      at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1.applyOrElse(JobManager.scala:967)
      at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
      at org.apache.flink.runtime.LeaderSessionMassageFilter$$anonfun$receive$1.applyOrEslse(LeaderSessionMessageFilter.scala:44)
      at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
      at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:33)
      at org.apache.flink.runtime.LogMessages$$anon$1.apply(LogMessages.scala:28)
      at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
      at org.apache.flink.runtime.LogMesages$$anon$1.applyOrElse(LogMessages.scala:28)
      

        Activity

        Hide
        dlmarion Dave Marion added a comment -

        It appears that an error serializing a custom accumulator in the task manager's heartbeat to the job manager caused this error.

        Show
        dlmarion Dave Marion added a comment - It appears that an error serializing a custom accumulator in the task manager's heartbeat to the job manager caused this error.
        Hide
        StephanEwen Stephan Ewen added a comment -

        Added an additional check to the JobManager that a null accumulator snapshot cannot bring the JobManager down.

        Show
        StephanEwen Stephan Ewen added a comment - Added an additional check to the JobManager that a null accumulator snapshot cannot bring the JobManager down.
        Hide
        StephanEwen Stephan Ewen added a comment -

        Fixed in

        • 1.1.5 via f6f1c244cf149d451a32fb3231a6bf1168bc31d1
        • 1.2.0 via e2a4f323292dfdee4c69c9261b265860cba6f6a0
        • 1.3.0 via 24ff9ebac926dda13c029c79c44c40580a5a1a2f
        Show
        StephanEwen Stephan Ewen added a comment - Fixed in 1.1.5 via f6f1c244cf149d451a32fb3231a6bf1168bc31d1 1.2.0 via e2a4f323292dfdee4c69c9261b265860cba6f6a0 1.3.0 via 24ff9ebac926dda13c029c79c44c40580a5a1a2f

          People

          • Assignee:
            StephanEwen Stephan Ewen
            Reporter:
            StephanEwen Stephan Ewen
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development