[SPARK-34111] Deconflict the jars jakarta.servlet-api-4.0.3.jar and javax.servlet-api-3.1.0.jar

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.1
• Component/s: Build
• Assignee: Kent Yao 2
• Reporter: Hyukjin Kwon
• Created: 14/Jan/21 06:14
• Updated: 12/Dec/22 18:11
• Resolved: 18/Jan/21 12:37

Description

After SPARK-33705, we now happened to have two jars in the release artifact with Hadoop 3:

dev/deps/spark-deps-hadoop-3.2-hive-2.3:

...
jakarta.servlet-api/4.0.3//jakarta.servlet-api-4.0.3.jar
...
javax.servlet-api/3.1.0//javax.servlet-api-3.1.0.jar
...

It can potentially cause an issue, and we should better remove javax.servlet-api-3.1.0.jar which is apparently only required for YARN tests.

Issue Links

• links to: [Github] Pull Request #31185 (yaooqinn)
• links to: [Github] Pull Request #31214 (yaooqinn)
• links to: [Github] Pull Request #31214 (yaooqinn)