[HDFS-10860] Switch HttpFS from Tomcat to Jetty - ASF JIRA

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Resolved
Priority: Blocker
Resolution: Fixed
Affects Version/s: 2.6.0
Fix Version/s: 3.0.0-alpha4
Component/s: httpfs
Labels:
None

Target Version/s:

3.0.0-alpha4
Hadoop Flags:

Incompatible change, Reviewed
Release Note:

Hide


The following environment variables are deprecated. Set the corresponding
configuration properties instead.

Environment Variable | Configuration Property | Configuration File
----------------------------|------------------------------|--------------------
HTTPFS_TEMP | hadoop.http.temp.dir | httpfs-site.xml
HTTPFS_HTTP_PORT | hadoop.httpfs.http.port | httpfs-site.xml
HTTPFS_MAX_HTTP_HEADER_SIZE | hadoop.http.max.request.header.size and hadoop.http.max.response.header.size | httpfs-site.xml
HTTPFS_MAX_THREADS | hadoop.http.max.threads | httpfs-site.xml
HTTPFS_SSL_ENABLED | hadoop.httpfs.ssl.enabled | httpfs-site.xml
HTTPFS_SSL_KEYSTORE_FILE | ssl.server.keystore.location | ssl-server.xml
HTTPFS_SSL_KEYSTORE_PASS | ssl.server.keystore.password | ssl-server.xml

These default HTTP Services have been added.

Name | Description
-------------------|------------------------------------
/conf | Display configuration properties
/jmx | Java JMX management interface
/logLevel | Get or set log level per class
/logs | Display log files
/stacks | Display JVM stacks
/static/index.html | The static home page

Script httpfs.sh has been deprecated, use `hdfs httpfs` instead. The new scripts are based on the Hadoop shell scripting framework. `hadoop daemonlog` is supported. SSL configurations are read from ssl-server.xml.

Show
 The following environment variables are deprecated. Set the corresponding configuration properties instead. Environment Variable | Configuration Property | Configuration File ----------------------------|------------------------------|-------------------- HTTPFS_TEMP | hadoop.http.temp.dir | httpfs-site.xml HTTPFS_HTTP_PORT | hadoop.httpfs.http.port | httpfs-site.xml HTTPFS_MAX_HTTP_HEADER_SIZE | hadoop.http.max.request.header.size and hadoop.http.max.response.header.size | httpfs-site.xml HTTPFS_MAX_THREADS | hadoop.http.max.threads | httpfs-site.xml HTTPFS_SSL_ENABLED | hadoop.httpfs.ssl.enabled | httpfs-site.xml HTTPFS_SSL_KEYSTORE_FILE | ssl.server.keystore.location | ssl-server.xml HTTPFS_SSL_KEYSTORE_PASS | ssl.server.keystore.password | ssl-server.xml These default HTTP Services have been added. Name | Description -------------------|------------------------------------ /conf | Display configuration properties /jmx | Java JMX management interface /logLevel | Get or set log level per class /logs | Display log files /stacks | Display JVM stacks /static/index.html | The static home page Script httpfs.sh has been deprecated, use `hdfs httpfs` instead. The new scripts are based on the Hadoop shell scripting framework. `hadoop daemonlog` is supported. SSL configurations are read from ssl-server.xml.

Description

The Tomcat 6 we are using will reach EOL at the end of 2017. While there are other good options, I would propose switching to Jetty 9 for the following reasons:

Easier migration. Both Tomcat and Jetty are based on Servlet Containers, so we don't have to change client code that much. It would require more work to switch to JAX-RS.
Well established.
Good performance and scalability.

Other alternatives: