Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-4866

Protocol buffer support cannot compile under C

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 3.0.0, 2.1.0-beta
    • Fix Version/s: 3.0.0, 2.1.0-beta
    • Component/s: namenode
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Hide
      The Protocol Buffers definition of the inter-namenode protocol required a change for compatibility with compiled C clients. This is a backwards-incompatible change. A namenode prior to this change will not be able to communicate with a namenode after this change.
      Show
      The Protocol Buffers definition of the inter-namenode protocol required a change for compatibility with compiled C clients. This is a backwards-incompatible change. A namenode prior to this change will not be able to communicate with a namenode after this change.

      Description

      When compiling Hadoop's .proto descriptions for use in C, an error occurs because one of the RPC's in NamenodeProtocol.proto is named "register". This name is a reserved word in languages such as C. When using the Java and C++ languages, the name is hidden inside a class and therefore doesn't cause an error. Unfortunately, that is not the case in non-class languages such as C.

      Note: generating the C translation of the .proto files requires installation of the protobuf-c package from google:

      http://code.google.com/p/protobuf-c/

      1. HDFS-4866.002.patch
        6 kB
        Arpit Agarwal
      2. HDFS-4866.branch-2.001.patch
        6 kB
        Arpit Agarwal
      3. HDFS-4866.trunk.001.patch
        7 kB
        Arpit Agarwal
      4. NamenodeProtocol.pb-c.c
        79 kB
        Ralph Castain
      5. NamenodeProtocol.pb-c.h
        46 kB
        Ralph Castain
      6. pcreate.pl
        8 kB
        Ralph Castain
      7. pcreate.pl
        6 kB
        Ralph Castain

        Issue Links

          Activity

          Ralph Castain created issue -
          Ralph Castain made changes -
          Field Original Value New Value
          Attachment NamenodeProtocol.pb-c.c [ 12585329 ]
          Attachment NamenodeProtocol.pb-c.h [ 12585330 ]
          Steve Loughran made changes -
          Project Hadoop Common [ 12310240 ] Hadoop HDFS [ 12310942 ]
          Key HADOOP-9606 HDFS-4866
          Affects Version/s 2.0.4-alpha [ 12324136 ]
          Affects Version/s 2.0.4-alpha [ 12324135 ]
          Ralph Castain made changes -
          Attachment pcreate.pl [ 12585418 ]
          Arpit Agarwal made changes -
          Assignee Arpit Agarwal [ arpitagarwal ]
          Suresh Srinivas made changes -
          Priority Major [ 3 ] Blocker [ 1 ]
          Affects Version/s 2.1.0-beta [ 12324031 ]
          Affects Version/s 2.0.4-alpha [ 12324136 ]
          Arpit Agarwal made changes -
          Affects Version/s 3.0.0 [ 12320356 ]
          Arpit Agarwal made changes -
          Fix Version/s 2.1.0-beta [ 12324031 ]
          Arpit Agarwal made changes -
          Fix Version/s 3.0.0 [ 12320356 ]
          Arpit Agarwal made changes -
          Fix Version/s 3.0.0 [ 12320356 ]
          Fix Version/s 2.1.0-beta [ 12324031 ]
          Arpit Agarwal made changes -
          Target Version/s 2.1.0-beta [ 12324031 ]
          Arpit Agarwal made changes -
          Attachment HDFS-4866.branch-2.001.patch [ 12586800 ]
          Attachment HDFS-4866.trunk.001.patch [ 12586801 ]
          Arpit Agarwal made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arpit Agarwal made changes -
          Attachment HDFS-4866.002.patch [ 12587900 ]
          Chris Nauroth made changes -
          Hadoop Flags Incompatible change,Reviewed [ 10342, 10343 ]
          Release Note The Protocol Buffers definition of the inter-namenode protocol required a change for compatibility with compiled C clients. This is a backwards-incompatible change. A namenode prior to this change will not be able to communicate with a namenode after this change.
          Chris Nauroth made changes -
          Component/s namenode [ 12312926 ]
          Chris Nauroth made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 3.0.0 [ 12320356 ]
          Fix Version/s 2.1.0-beta [ 12324031 ]
          Resolution Fixed [ 1 ]
          Ralph Castain made changes -
          Attachment pcreate.pl [ 12587982 ]
          Fengdong Yu made changes -
          Link This issue is related to HDFS-4909 [ HDFS-4909 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Arpit Agarwal
              Reporter:
              Ralph Castain
            • Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development