[TEZ-4322] Some jetty jars are not generated in tez-dist

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Assignee: Unassigned
• Reporter: Takanobu Asanuma
• Created: 04/Aug/21 05:24
• Updated: 19/Aug/21 11:13
• Resolved: 19/Aug/21 11:12

Description

built tez specifying hadoop-3.3.1 with master branch

$ tez git:(master) mvn clean package -Dhadoop.version=3.3.1 -DskipTests -Dmaven.javadoc.skip=true -Dallow.root.build=true

submitted tez job

$ hadoop jar tez-examples-0.10.2-SNAPSHOT.jar orderedwordcount data output1

Tez AM failed with the following error.

2021-08-02 16:47:14,063 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster
org.apache.hadoop.service.ServiceStateException: java.lang.NoClassDefFoundError: org/eclipse/jetty/servlet/ServletContextHandler
	at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:105)
	at org.apache.tez.dag.app.DAGAppMaster.startServices(DAGAppMaster.java:1879)
	at org.apache.tez.dag.app.DAGAppMaster.serviceStart(DAGAppMaster.java:1943)
	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
	at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2626)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)
	at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2622)
	at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2409)

I think generated jetty jars are not enough. (there are not jetty-servlet, jetty-webapp, etc )

$ tez git:(master) find  tez-dist/target | grep jetty
tez-dist/target/tez-0.10.2-SNAPSHOT/lib/jetty-io-9.4.40.v20210413.jar
tez-dist/target/tez-0.10.2-SNAPSHOT/lib/jetty-util-9.4.40.v20210413.jar
tez-dist/target/tez-0.10.2-SNAPSHOT/lib/jetty-http-9.4.40.v20210413.jar
tez-dist/target/tez-0.10.2-SNAPSHOT/lib/jetty-client-9.4.40.v20210413.jar

Issue Links

• duplicates: TEZ-4323 Jetty jars were removed from dist package with TEZ-4114