[SPARK-30028] Spark Catalyst build fails with Maven -rf :spark-core_2.12

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: Build

Environment

Building with OpenJDK-11, Scala 2.12.8 and Maven 3.6.2.

Using Debian 10 with kernel 4.19.0-6-amd64.

Running inside a VirtualBox hosted on a MacBook Pro.

• Assignee: Unassigned
• Reporter: Douglas Colkitt
• Created: 25/Nov/19 16:23
• Updated: 25/Nov/19 23:19

Description

Building from latest source with the following command: 

./build/mvn -DskipTests clean package  

Then manually interrupt the build at the Spark Core stage. Then resume build with

./build/mvn -DskipTests clean package -rf :spark-core_2.12

Fails at Spark Project Catalyst stage with the following errors:

[INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-catalyst_2.12 ---
[INFO] Using incremental compilation using Mixed compile order
[INFO] Compiler bridge file: /home/vagrant/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
[INFO] Compiling 300 Scala sources and 91 Java sources to /home/vagrant/spark/sql/catalyst/target/scala-2.12/classes ...
[WARNING] [Warn] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala:105: Java enum ALLOW_UNQUOTED_CONTROL_CHARS in Java enum Feature is deprecated: see corresponding Javadoc for more information.
[ERROR] [Error] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/postgreSQL/PostgreCastToBoolean.scala:45: value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
[WARNING] [Warn] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:137: Java enum ALLOW_NUMERIC_LEADING_ZEROS in Java enum Feature is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:138: Java enum ALLOW_NON_NUMERIC_NUMBERS in Java enum Feature is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:139: Java enum ALLOW_BACKSLASH_ESCAPING_ANY_CHARACTER in Java enum Feature is deprecated: see corresponding Javadoc for more information.
[WARNING] [Warn] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:141: Java enum ALLOW_UNQUOTED_CONTROL_CHARS in Java enum Feature is deprecated: see corresponding Javadoc for more information.
[ERROR] [Error] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala:208: value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
[ERROR] [Error] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala:375: value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
[ERROR] [Error] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala:468: value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
[WARNING] 5 warnings found
 

This does not occur with an uninterrupted build.

I believe it's related to the changes introduced by commit __

de21f28f8a0a41dd7eb8ed1ff8b35a6d7538958b on November 25, as the build doesn't break with an earlier revision.