[SPARK-16580] [WARN] class Accumulator in package spark is deprecated: use AccumulatorV2

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 2.0.0
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: Xin Ren
• Created: 15/Jul/16 21:30
• Updated: 05/Aug/16 07:29
• Resolved: 05/Aug/16 07:29

Description

When I was working on the R wrapper, I found the compile warn.

> project mllib
> console
[warn] /Users/renxin/workspace/spark/core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala:78: class Accumulator in package spark is deprecated: use AccumulatorV2
[warn]     accumulator: Accumulator[JList[Array[Byte]]])
[warn]
[warn] /Users/renxin/workspace/spark/core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala:78: class Accumulator in package spark is deprecated: use AccumulatorV2
[warn]     accumulator: Accumulator[JList[Array[Byte]]])
[warn]
[warn] /Users/renxin/workspace/spark/core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala:78: class Accumulator in package spark is deprecated: use AccumulatorV2
[warn]     accumulator: Accumulator[JList[Array[Byte]]])
[warn]
[warn] /Users/renxin/workspace/spark/core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala:71: class Accumulator in package spark is deprecated: use AccumulatorV2
[warn] private[spark] case class PythonFunction(
[warn]
[warn] /Users/renxin/workspace/spark/core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala:78: class Accumulator in package spark is deprecated: use AccumulatorV2
[warn]     accumulator: Accumulator[JList[Array[Byte]]])
[warn]
[warn] /Users/renxin/workspace/spark/core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala:873: trait AccumulatorParam in package spark is deprecated: use AccumulatorV2
[warn]   extends AccumulatorParam[JList[Array[Byte]]] {
[warn]
[warn] /Users/renxin/workspace/spark/core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala:459: trait AccumulableParam in package spark is deprecated: use AccumulatorV2
[warn]     param: org.apache.spark.AccumulableParam[R, T]) extends AccumulatorV2[T, R] {
[warn]
[warn] /Users/renxin/workspace/spark/core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala:459: trait AccumulableParam in package spark is deprecated: use AccumulatorV2
[warn]     param: org.apache.spark.AccumulableParam[R, T]) extends AccumulatorV2[T, R] {
[warn]

Issue Links

• duplicates: SPARK-16861 Refactor PySpark accumulator API to be on top of AccumulatorV2 API
• links to: [Github] Pull Request #14226 (keypointt)