Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2656

Implement a pure c client based on webhdfs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.3-alpha
    • webhdfs
    • None
    • Reviewed

    Description

      Currently, the implementation of libhdfs is based on JNI. The overhead of JVM seems a little big, and libhdfs can also not be used in the environment without hdfs.
      It seems a good idea to implement a pure c client by wrapping webhdfs. It also can be used to access different version of hdfs.

      Attachments

        1. teragen_terasort_teravalidate_performance.png
          39 kB
          Jing Zhao
        2. HDFS-2656.unfinished.patch
          68 kB
          Jing Zhao
        3. HDFS-2656.patch
          188 kB
          Jing Zhao
        4. HDFS-2656.patch
          208 kB
          Jing Zhao
        5. HDFS-2656.patch
          212 kB
          Jing Zhao

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-3916 libwebhdfs (C client) code cleanups

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. HDFS-2316 [umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-2631 Add optional libwebhdfs support to fuse-dfs

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-3909 Change Jenkins setting to test libwebhdfs

          • Major - Major loss of function.
          • Resolved
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-3952 Support hdfsHFlush and hdfsFlush in libwebhdfs (C client)

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-3917 Remove JNI code from libwebhdfs (C client library)

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              jingzhao Jing Zhao
              wangzw Zhanwei Wang
              Votes:
              0 Vote for this issue
              Watchers:
              27 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: