[HDFS-2656] Implement a pure c client based on webhdfs

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.3-alpha
• Component/s: webhdfs
• Hadoop Flags: Reviewed
• Assignee: Jing Zhao
• Reporter: Zhanwei Wang
• Created: 10/Dec/11 13:55
• Updated: 15/Feb/13 17:11
• Resolved: 10/Sep/12 17:50

Description

Currently, the implementation of libhdfs is based on JNI. The overhead of JVM seems a little big, and libhdfs can also not be used in the environment without hdfs.
It seems a good idea to implement a pure c client by wrapping webhdfs. It also can be used to access different version of hdfs.

Issue Links

• is related to: HDFS-3916 libwebhdfs (C client) code cleanups
• is related to: HDFS-2316 [umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP
• is related to: HDFS-2631 Add optional libwebhdfs support to fuse-dfs
• is related to: HDFS-3909 Change Jenkins setting to test libwebhdfs
• relates to: HDFS-3952 Support hdfsHFlush and hdfsFlush in libwebhdfs (C client)
• relates to: HDFS-3917 Remove JNI code from libwebhdfs (C client library)