Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-30364

The spark-streaming-kafka-0-10_2.11 test cases are failing on ppc64le

    XMLWordPrintableJSON

    Details

    • Type: Test
    • Status: Resolved
    • Priority: Major
    • Resolution: Incomplete
    • Affects Version/s: 2.4.0
    • Fix Version/s: None
    • Component/s: Build, DStreams
    • Labels:
    • Environment:

      os: rhel 7.6
      arch: ppc64le

      Description

      I have been trying to build the Apache Spark on rhel_7.6/ppc64le; however, the spark-streaming-kafka-0-10_2.11 test cases are failing with following error :

      [ERROR] /opt/spark/external/kafka-0-10/src/test/scala/org/apache/spark/streaming/kafka010/KafkaDataConsumerSuite.scala:85: Symbol 'term org.eclipse' is missing from the classpath.
      This symbol is required by 'method org.apache.spark.metrics.MetricsSystem.getServletHandlers'.
      Make sure that term eclipse is in your classpath and check for conflicting dependencies with `-Ylog-classpath`.
      A full rebuild may help if 'MetricsSystem.class' was compiled against an incompatible version of org.
      [ERROR]     testUtils.sendMessages(topic, data.toArray)                                  ^
      

      Would like some help on understanding the cause for the same . I am running it on a High end VM with good connectivity.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              AK2019 AK97
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: