Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-33772 Build and Run Spark on Java 17
  3. SPARK-37120

Add Daily GitHub Action jobs for Java11/17

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.0
    • 3.3.0
    • jenkins
    • None

    Description

      Now run

      build/mvn clean install -Phadoop-3.2 -Phive-2.3 -Phadoop-cloud -Pmesos -Pyarn -Pkinesis-asl -Phive-thriftserver -Pspark-ganglia-lgpl -Pkubernetes -Phive
      

      to build and test whole project(Head is 87591c9b22157cfd241af6ea2533359c3fba1bb2) with Java 17. It seems that all the UTs have passed.

       

      [INFO] ------------------------------------------------------------------------
      [INFO] Reactor Summary for Spark Project Parent POM 3.3.0-SNAPSHOT:
      [INFO] 
      [INFO] Spark Project Parent POM ........................... SUCCESS [  1.971 s]
      [INFO] Spark Project Tags ................................. SUCCESS [  2.170 s]
      [INFO] Spark Project Sketch ............................... SUCCESS [ 14.008 s]
      [INFO] Spark Project Local DB ............................. SUCCESS [  2.466 s]
      [INFO] Spark Project Networking ........................... SUCCESS [ 49.650 s]
      [INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [  7.095 s]
      [INFO] Spark Project Unsafe ............................... SUCCESS [  1.826 s]
      [INFO] Spark Project Launcher ............................. SUCCESS [  1.851 s]
      [INFO] Spark Project Core ................................. SUCCESS [24:40 min]
      [INFO] Spark Project ML Local Library ..................... SUCCESS [ 17.816 s]
      [INFO] Spark Project GraphX ............................... SUCCESS [01:27 min]
      [INFO] Spark Project Streaming ............................ SUCCESS [04:57 min]
      [INFO] Spark Project Catalyst ............................. SUCCESS [07:56 min]
      [INFO] Spark Project SQL .................................. SUCCESS [  01:01 h]
      [INFO] Spark Project ML Library ........................... SUCCESS [16:46 min]
      [INFO] Spark Project Tools ................................ SUCCESS [  0.748 s]
      [INFO] Spark Project Hive ................................. SUCCESS [  01:11 h]
      [INFO] Spark Project REPL ................................. SUCCESS [01:26 min]
      [INFO] Spark Project YARN Shuffle Service ................. SUCCESS [  0.967 s]
      [INFO] Spark Project YARN ................................. SUCCESS [06:54 min]
      [INFO] Spark Project Mesos ................................ SUCCESS [ 46.913 s]
      [INFO] Spark Project Kubernetes ........................... SUCCESS [01:08 min]
      [INFO] Spark Project Hive Thrift Server ................... SUCCESS [19:12 min]
      [INFO] Spark Ganglia Integration .......................... SUCCESS [  4.610 s]
      [INFO] Spark Project Hadoop Cloud Integration ............. SUCCESS [ 11.400 s]
      [INFO] Spark Project Assembly ............................. SUCCESS [  2.496 s]
      [INFO] Kafka 0.10+ Token Provider for Streaming ........... SUCCESS [ 19.870 s]
      [INFO] Spark Integration for Kafka 0.10 ................... SUCCESS [01:20 min]
      [INFO] Kafka 0.10+ Source for Structured Streaming ........ SUCCESS [35:06 min]
      [INFO] Spark Kinesis Integration .......................... SUCCESS [ 29.667 s]
      [INFO] Spark Project Examples ............................. SUCCESS [ 32.189 s]
      [INFO] Spark Integration for Kafka 0.10 Assembly .......... SUCCESS [  0.949 s]
      [INFO] Spark Avro ......................................... SUCCESS [01:55 min]
      [INFO] Spark Project Kinesis Assembly ..................... SUCCESS [  1.104 s]
      [INFO] ------------------------------------------------------------------------
      [INFO] BUILD SUCCESS
      [INFO] ------------------------------------------------------------------------
      [INFO] Total time:  04:19 h
      [INFO] Finished at: 2021-10-26T20:02:56+08:00
      [INFO] ------------------------------------------------------------------------
      

      So should we add a Jenkins build and test job for Java 17?

      Attachments

        Activity

          People

            dongjoon Dongjoon Hyun
            LuciferYang Yang Jie
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: