Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2656

Implement a pure c client based on webhdfs

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.3-alpha
    • Component/s: webhdfs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently, the implementation of libhdfs is based on JNI. The overhead of JVM seems a little big, and libhdfs can also not be used in the environment without hdfs.
      It seems a good idea to implement a pure c client by wrapping webhdfs. It also can be used to access different version of hdfs.

        Attachments

        1. teragen_terasort_teravalidate_performance.png
          39 kB
          Jing Zhao
        2. HDFS-2656.unfinished.patch
          68 kB
          Jing Zhao
        3. HDFS-2656.patch
          188 kB
          Jing Zhao
        4. HDFS-2656.patch
          208 kB
          Jing Zhao
        5. HDFS-2656.patch
          212 kB
          Jing Zhao

        Issue Links

          Activity

            People

            • Assignee:
              jingzhao Jing Zhao
              Reporter:
              wangzw Zhanwei Wang

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment