Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-932

Findbugs doesn't pass in Spark runner

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 0.5.0
    • runner-spark
    • None

    Description

      [INFO] --- findbugs-maven-plugin:3.0.1:check (default) @ beam-runners-spark ---
[INFO] BugInstance size is 19
[INFO] Error size is 0
[INFO] Total bugs: 19
[INFO] instanceof will always return false in org.apache.beam.runners.spark.SparkRunner.run(Pipeline), since a RuntimeException can't be a org.apache.spark.SparkException [org.apache.beam.runners.spark.SparkRunner] At SparkRunner.java:[line 161]
[INFO] org.apache.beam.runners.spark.aggregators.metrics.WithNamedAggregatorsSupport$1.apply(Map$Entry) makes inefficient use of keySet iterator instead of entrySet iterator [org.apache.beam.runners.spark.aggregators.metrics.WithNamedAggregatorsSupport$1] At WithNamedAggregatorsSupport.java:[line 125]
[INFO] The class name org.apache.beam.runners.spark.aggregators.metrics.sink.CsvSink shadows the simple name of the superclass org.apache.spark.metrics.sink.CsvSink [org.apache.beam.runners.spark.aggregators.metrics.sink.CsvSink] At CsvSink.java:[lines 37-38]
[INFO] The class name org.apache.beam.runners.spark.aggregators.metrics.sink.GraphiteSink shadows the simple name of the superclass org.apache.spark.metrics.sink.GraphiteSink [org.apache.beam.runners.spark.aggregators.metrics.sink.GraphiteSink] At GraphiteSink.java:[lines 37-38]
[INFO] t must be non-null but is marked as nullable [org.apache.beam.runners.spark.translation.WindowingHelpers$4] At WindowingHelpers.java:[line 88]
[INFO] Unchecked/unconfirmed cast from org.apache.beam.runners.spark.translation.EvaluationContext to org.apache.beam.runners.spark.translation.streaming.StreamingEvaluationContext in org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$1.evaluate(ConsoleIO$Write$Unbound, EvaluationContext) [org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$1] At StreamingTransformTranslator.java:[line 92]
[INFO] Unchecked/unconfirmed cast from org.apache.beam.runners.spark.translation.EvaluationContext to org.apache.beam.runners.spark.translation.streaming.StreamingEvaluationContext in org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$10.evaluate(ParDo$Bound, EvaluationContext) [org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$10] At StreamingTransformTranslator.java:[line 360]
[INFO] Unchecked/unconfirmed cast from org.apache.beam.runners.spark.translation.EvaluationContext to org.apache.beam.runners.spark.translation.streaming.StreamingEvaluationContext in org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$11.evaluate(ParDo$BoundMulti, EvaluationContext) [org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$11] At StreamingTransformTranslator.java:[line 395]
[INFO] Unchecked/unconfirmed cast from org.apache.beam.runners.spark.translation.EvaluationContext to org.apache.beam.runners.spark.translation.streaming.StreamingEvaluationContext in org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$2.evaluate(Read$Unbounded, EvaluationContext) [org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$2] At StreamingTransformTranslator.java:[line 104]
[INFO] Unchecked/unconfirmed cast from org.apache.beam.runners.spark.translation.EvaluationContext to org.apache.beam.runners.spark.translation.streaming.StreamingEvaluationContext in org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$3.evaluate(CreateStream$QueuedValues, EvaluationContext) [org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$3] At StreamingTransformTranslator.java:[line 115]
[INFO] Unchecked/unconfirmed cast from org.apache.beam.runners.spark.translation.EvaluationContext to org.apache.beam.runners.spark.translation.streaming.StreamingEvaluationContext in org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$4.evaluate(Flatten$FlattenPCollectionList, EvaluationContext) [org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$4] At StreamingTransformTranslator.java:[line 128]
[INFO] Unchecked/unconfirmed cast from org.apache.beam.runners.spark.translation.EvaluationContext to org.apache.beam.runners.spark.translation.streaming.StreamingEvaluationContext in org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$5.evaluate(Window$Bound, EvaluationContext) [org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$5] At StreamingTransformTranslator.java:[line 167]
[INFO] Unchecked/unconfirmed cast from org.apache.beam.runners.spark.translation.EvaluationContext to org.apache.beam.runners.spark.translation.streaming.StreamingEvaluationContext in org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$6.evaluate(GroupByKey, EvaluationContext) [org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$6] At StreamingTransformTranslator.java:[line 215]
[INFO] Unchecked/unconfirmed cast from org.apache.beam.runners.spark.translation.EvaluationContext to org.apache.beam.runners.spark.translation.streaming.StreamingEvaluationContext in org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$7.evaluate(Combine$GroupedValues, EvaluationContext) [org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$7] At StreamingTransformTranslator.java:[line 251]
[INFO] Unchecked/unconfirmed cast from org.apache.beam.runners.spark.translation.EvaluationContext to org.apache.beam.runners.spark.translation.streaming.StreamingEvaluationContext in org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$8.evaluate(Combine$Globally, EvaluationContext) [org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$8] At StreamingTransformTranslator.java:[line 281]
[INFO] Unchecked/unconfirmed cast from org.apache.beam.runners.spark.translation.EvaluationContext to org.apache.beam.runners.spark.translation.streaming.StreamingEvaluationContext in org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$9.evaluate(Combine$PerKey, EvaluationContext) [org.apache.beam.runners.spark.translation.streaming.StreamingTransformTranslator$9] At StreamingTransformTranslator.java:[line 321]
[INFO] Inconsistent synchronization of org.apache.beam.runners.spark.util.BroadcastHelper$CodedBroadcastHelper.value; locked 75% of time [org.apache.beam.runners.spark.util.BroadcastHelper$CodedBroadcastHelper, org.apache.beam.runners.spark.util.BroadcastHelper$CodedBroadcastHelper, org.apache.beam.runners.spark.util.BroadcastHelper$CodedBroadcastHelper, org.apache.beam.runners.spark.util.BroadcastHelper$CodedBroadcastHelper] Unsynchronized access at BroadcastHelper.java:[line 111]Synchronized access at BroadcastHelper.java:[line 103]Synchronized access at BroadcastHelper.java:[line 106]Synchronized access at BroadcastHelper.java:[line 104]
[INFO] Inconsistent synchronization of org.apache.beam.runners.spark.util.BroadcastHelper$DirectBroadcastHelper.bcast; locked 50% of time [org.apache.beam.runners.spark.util.BroadcastHelper$DirectBroadcastHelper, org.apache.beam.runners.spark.util.BroadcastHelper$DirectBroadcastHelper] Unsynchronized access at BroadcastHelper.java:[line 81]Synchronized access at BroadcastHelper.java:[line 74]
[INFO] Inconsistent synchronization of org.apache.beam.runners.spark.util.BroadcastHelper$DirectBroadcastHelper.value; locked 75% of time [org.apache.beam.runners.spark.util.BroadcastHelper$DirectBroadcastHelper, org.apache.beam.runners.spark.util.BroadcastHelper$DirectBroadcastHelper, org.apache.beam.runners.spark.util.BroadcastHelper$DirectBroadcastHelper, org.apache.beam.runners.spark.util.BroadcastHelper$DirectBroadcastHelper] Unsynchronized access at BroadcastHelper.java:[line 81]Synchronized access at BroadcastHelper.java:[line 73]Synchronized access at BroadcastHelper.java:[line 76]Synchronized access at BroadcastHelper.java:[line 74]
[INFO]

      Attachments

        Issue Links

          is a clone of

          Bug - A problem which impairs or prevents the functions of the product. BEAM-931 Findbugs doesn't pass in Flink runner

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Triage Needed
          is cloned by

          Bug - A problem which impairs or prevents the functions of the product. BEAM-933 Findbugs doesn't pass in Java Examples

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved
          links to

          Web Link GitHub Pull Request #1463

          Activity

            People

              iemejia Ismaël Mejía
              dhalperi Dan Halperin
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: