[SPARK-41894] sql/core module mvn clean failed

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: Structured Streaming, Tests
• Assignee: Yang Jie
• Reporter: Yang Jie
• Created: 05/Jan/23 07:28
• Updated: 09/Jan/23 02:22
• Resolved: 09/Jan/23 02:22

Description

run the following commands:

1. mvn clean install -pl sql/core -am -DskipTests
2. mvn test -pl sql/core 
3. mvn clean

 

then following error:

 

[INFO] Spark Project Parent POM ........................... SUCCESS [  0.133 s]
[INFO] Spark Project Tags ................................. SUCCESS [  0.008 s]
[INFO] Spark Project Sketch ............................... SUCCESS [  0.007 s]
[INFO] Spark Project Local DB ............................. SUCCESS [  0.008 s]
[INFO] Spark Project Networking ........................... SUCCESS [  0.015 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [  0.020 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [  0.007 s]
[INFO] Spark Project Launcher ............................. SUCCESS [  0.008 s]
[INFO] Spark Project Core ................................. SUCCESS [  0.279 s]
[INFO] Spark Project ML Local Library ..................... SUCCESS [  0.010 s]
[INFO] Spark Project GraphX ............................... SUCCESS [  0.016 s]
[INFO] Spark Project Streaming ............................ SUCCESS [  0.039 s]
[INFO] Spark Project Catalyst ............................. SUCCESS [  0.262 s]
[INFO] Spark Project SQL .................................. FAILURE [  1.305 s]
[INFO] Spark Project ML Library ........................... SKIPPED
[INFO] Spark Project Tools ................................ SKIPPED
[INFO] Spark Project Hive ................................. SKIPPED
[INFO] Spark Project REPL ................................. SKIPPED
[INFO] Spark Project YARN Shuffle Service ................. SKIPPED
[INFO] Spark Project YARN ................................. SKIPPED
[INFO] Spark Project Mesos ................................ SKIPPED
[INFO] Spark Project Kubernetes ........................... SKIPPED
[INFO] Spark Project Hive Thrift Server ................... SKIPPED
[INFO] Spark Ganglia Integration .......................... SKIPPED
[INFO] Spark Project Hadoop Cloud Integration ............. SKIPPED
[INFO] Spark Project Assembly ............................. SKIPPED
[INFO] Kafka 0.10+ Token Provider for Streaming ........... SKIPPED
[INFO] Spark Integration for Kafka 0.10 ................... SKIPPED
[INFO] Kafka 0.10+ Source for Structured Streaming ........ SKIPPED
[INFO] Spark Kinesis Integration .......................... SKIPPED
[INFO] Spark Project Examples ............................. SKIPPED
[INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED
[INFO] Spark Avro ......................................... SKIPPED
[INFO] Spark Project Connect Common ....................... SKIPPED
[INFO] Spark Project Connect Server ....................... SKIPPED
[INFO] Spark Project Connect Client ....................... SKIPPED
[INFO] Spark Protobuf ..................................... SKIPPED
[INFO] Spark Project Kinesis Assembly ..................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  2.896 s
[INFO] Finished at: 2023-01-05T15:15:57+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-clean-plugin:3.1.0:clean (default-clean) on project spark-sql_2.13: Failed to clean project: Failed to delete /${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc -> [Help 1]
 

 

 

run :

• ll /${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc

 

 

-rw-r--r-- 1 work work 12 Dec 28 16:06 /${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc

 

 

and current user(work) can't rm this file:

• rm  /${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc

 

rm: cannot remove `/${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc': Permission denied 

need to use root to clean this file

 

Issue Links

• links to: [Github] Pull Request #39406 (LuciferYang)
• links to: [Github] Pull Request #39406 (LuciferYang)