| Key: |
HADOOP-5010
|
| Type: |
Improvement
|
| Status: |
Open
|
| Priority: |
Trivial
|
| Assignee: |
Unassigned
|
| Reporter: |
Marco Nicosia
|
| Votes: |
0
|
| Watchers: |
8
|
|
If you were logged in you would be able to see more operations.
|
|
|
In HADOOP-1563,  Doug Cutting wrote:
The URI for this should be something like hftp://host:port/a/b/c, since, while HTTP will be used as the transport, this will not be a FileSystem for arbitrary HTTP urls.
Recently, we've been talking about implementing an HDFS proxy (HADOOP-4575) which would be a secure way to make HFTP/HSFTP available. In so doing, we may even remove HFTP/HSFTP from being offered on the HDFS itself (that's another discussion).
In the case of the HDFS proxy, does it make sense to do away with the artificial HFTP/HSFTP protocols, and instead simply offer standard HTTP and HTTPS? That would allow non-HDFS-specific clients, as well as using various standard HTTP infrastructure, such as load balancers, etc.
NB, to the best of my knowledge, HFTP is only documented on the distcp page, and HSFTP is not documented at all?
|
|
Description
|
In HADOOP-1563, Doug Cutting wrote:
The URI for this should be something like hftp://host:port/a/b/c, since, while HTTP will be used as the transport, this will not be a FileSystem for arbitrary HTTP urls.
Recently, we've been talking about implementing an HDFS proxy ( HADOOP-4575) which would be a secure way to make HFTP/HSFTP available. In so doing, we may even remove HFTP/HSFTP from being offered on the HDFS itself (that's another discussion).
In the case of the HDFS proxy, does it make sense to do away with the artificial HFTP/HSFTP protocols, and instead simply offer standard HTTP and HTTPS? That would allow non-HDFS-specific clients, as well as using various standard HTTP infrastructure, such as load balancers, etc.
NB, to the best of my knowledge, HFTP is only documented on the distcp page, and HSFTP is not documented at all? |
Show » |
made changes - 14/Jan/09 02:55 AM
| Field |
Original Value |
New Value |
|
Component/s
|
contrib/hdfsproxy
[ 12312547
]
|
|
|
Component/s
|
|
documentation
[ 12311160
]
|
|
Fix Version/s
|
|
0.20.0
[ 12313438
]
|
made changes - 14/Jan/09 06:23 PM
|
Summary
|
Replace HFTP/HSFTP with plain HTTP/HTTPS
|
Document HTTP/HTTPS methods to read directory and file data
|
made changes - 23/Jan/09 02:26 AM
|
Attachment
|
|
5010-0.patch
[ 12398527
]
|
made changes - 23/Jan/09 02:26 AM
|
Fix Version/s
|
0.20.0
[ 12313438
]
|
|
|
Priority
|
Major
[ 3
]
|
Trivial
[ 5
]
|
|
Fix Version/s
|
|
0.21.0
[ 12313563
]
|
|
Document HTTP/HTTPS methods to read directory and file data
