[BIGTOP-1778] spark-1.3.0 broke hive

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 1.0.0
• Component/s: build
• Assignee: Olaf Flebbe
• Reporter: Olaf Flebbe
• Created: 27/Mar/15 09:31
• Updated: 23/Apr/15 02:43
• Resolved: 27/Mar/15 21:31

Description

[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR : 
[INFO] -------------------------------------------------------------
[ERROR] /home/olaf/bigtop/output/hive/hive-1.1.0/spark-client/src/main/java/org/apache/hive/spark/client/RemoteDriver.java:[423,11] org.apache.hive.spark.client.RemoteDriver.ClientListener is not abstract and does not override abstract method onExecutorRemoved(org.apache.spark.scheduler.SparkListenerExecutorRemoved) in org.apache.spark.scheduler.SparkListener
[INFO] 1 error
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Hive .............................................. SUCCESS [3.328s]
[INFO] Hive Shims Common ................................. SUCCESS [4.690s]
[INFO] Hive Shims 0.20S .................................. SUCCESS [0.950s]
[INFO] Hive Shims 0.23 ................................... SUCCESS [3.070s]
[INFO] Hive Shims Scheduler .............................. SUCCESS [0.589s]
[INFO] Hive Shims ........................................ SUCCESS [0.553s]
[INFO] Hive Common ....................................... SUCCESS [3.379s]
[INFO] Hive Serde ........................................ SUCCESS [5.979s]
[INFO] Hive Metastore .................................... SUCCESS [12.397s]
[INFO] Hive Ant Utilities ................................ SUCCESS [0.430s]
[INFO] Spark Remote Client ............................... FAILURE [5.161s]
[INFO] Hive Query Language ............................... SKIPPED
[INFO] Hive Service ...................................... SKIPPED
[INFO] Hive Accumulo Handler ............................. SKIPPED
[INFO] Hive JDBC ......................................... SKIPPED
[INFO] Hive Beeline ...................................... SKIPPED
[INFO] Hive CLI .......................................... SKIPPED
[INFO] Hive Contrib ...................................... SKIPPED
[INFO] Hive HBase Handler ................................ SKIPPED
[INFO] Hive HCatalog ..................................... SKIPPED
[INFO] Hive HCatalog Core ................................ SKIPPED
[INFO] Hive HCatalog Pig Adapter ......................... SKIPPED
[INFO] Hive HCatalog Server Extensions ................... SKIPPED
[INFO] Hive HCatalog Webhcat Java Client ................. SKIPPED
[INFO] Hive HCatalog Webhcat ............................. SKIPPED
[INFO] Hive HCatalog Streaming ........................... SKIPPED
[INFO] Hive HWI .......................................... SKIPPED
[INFO] Hive ODBC ......................................... SKIPPED
[INFO] Hive Shims Aggregator ............................. SKIPPED
[INFO] Hive TestUtils .................................... SKIPPED
[INFO] Hive Packaging .................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 41.394s
[INFO] Finished at: Fri Mar 27 10:28:06 CET 2015
[INFO] Final Memory: 79M/1364M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on project spark-client: Compilation failure
[ERROR] /home/olaf/bigtop/output/hive/hive-1.1.0/spark-client/src/main/java/org/apache/hive/spark/client/RemoteDriver.java:[423,11] org.apache.hive.spark.client.RemoteDriver.ClientListener is not abstract and does not override abstract method onExecutorRemoved(org.apache.spark.scheduler.SparkListenerExecutorRemoved) in org.apache.spark.scheduler.SparkListener
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :spark-client

Issue Links

• is related to: BIGTOP-1789 Spark 1.3.0 incompatible with Hive 1.1.0
• is related to: BIGTOP-1846 Upgrade Hive to 1.2.0