Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2656

Implement a pure c client based on webhdfs

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.3-alpha
    • Component/s: webhdfs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently, the implementation of libhdfs is based on JNI. The overhead of JVM seems a little big, and libhdfs can also not be used in the environment without hdfs.
      It seems a good idea to implement a pure c client by wrapping webhdfs. It also can be used to access different version of hdfs.

      1. HDFS-2656.patch
        212 kB
        Jing Zhao
      2. teragen_terasort_teravalidate_performance.png
        39 kB
        Jing Zhao
      3. HDFS-2656.patch
        208 kB
        Jing Zhao
      4. HDFS-2656.patch
        188 kB
        Jing Zhao
      5. HDFS-2656.unfinished.patch
        68 kB
        Jing Zhao

        Issue Links

          Activity

          Zhanwei Wang created issue -
          Zhanwei Wang made changes -
          Field Original Value New Value
          Link This issue is related to HDFS-2316 [ HDFS-2316 ]
          Zhanwei Wang made changes -
          Link This issue is related to HDFS-2631 [ HDFS-2631 ]
          Eli Collins made changes -
          Component/s webhdfs [ 12319200 ]
          Jing Zhao made changes -
          Attachment HDFS-2656.unfinished.patch [ 12537788 ]
          Jing Zhao made changes -
          Attachment HDFS-2656.patch [ 12539751 ]
          Jing Zhao made changes -
          Attachment HDFS-2656.patch [ 12542012 ]
          Attachment teragen_terasort_teravalidate_performance.png [ 12542013 ]
          Jing Zhao made changes -
          Assignee Jing Zhao [ jingzhao ]
          Jing Zhao made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Affects Version/s 3.0.0 [ 12320356 ]
          Jing Zhao made changes -
          Attachment HDFS-2656.patch [ 12544145 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue is related to HDFS-3909 [ HDFS-3909 ]
          Tsz Wo Nicholas Sze made changes -
          Hadoop Flags Reviewed [ 10343 ]
          Affects Version/s 3.0.0 [ 12320356 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 2.0.3-alpha [ 12323274 ]
          Resolution Fixed [ 1 ]
          Colin Patrick McCabe made changes -
          Link This issue is related to HDFS-3916 [ HDFS-3916 ]
          Jing Zhao made changes -
          Link This issue relates to HDFS-3917 [ HDFS-3917 ]
          Jing Zhao made changes -
          Fix Version/s 3.0.0 [ 12320356 ]
          Fix Version/s 2.0.3-alpha [ 12323274 ]
          Eli Collins made changes -
          Fix Version/s 2.0.3-alpha [ 12323274 ]
          Fix Version/s 3.0.0 [ 12320356 ]
          Jing Zhao made changes -
          Link This issue relates to HDFS-3952 [ HDFS-3952 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Jing Zhao
              Reporter:
              Zhanwei Wang
            • Votes:
              0 Vote for this issue
              Watchers:
              28 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development