[HBASE-19146] Hbase3.0 protobuf-maven-plugin do not support Arm64(only for x86)

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 3.0.0-alpha-1
• Component/s: build, pom

Environment

OS: Ubuntu 16.04.3
OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-2ubuntu1.16.04.3-b11)
Hw platform: AARCH64

• Assignee: Unassigned
• Reporter: Yuqi Gu
• Created: 01/Nov/17 06:07
• Updated: 05/May/20 23:53
• Resolved: 05/May/20 23:53

Description

We are building the HBase 3.0.0-SNAPSHOT on AARCH64.
It is noted that 'protobuf-maven-plugin' only support x86 shown as follows:

 <plugin>
   <groupId>org.xolstice.maven.plugins</groupId>
   <artifactId>protobuf-maven-plugin</artifactId>
   <version>${protobuf.plugin.version}</version>
   <configuration>            
      <protocArtifact>com.google.protobuf:protoc:${external.protobuf.version}:
        exe:${os.detected.classifier}</protocArtifact>


    <protocArtifact>com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}</protocArtifact>
    

       <clearOutputDirectory>false</clearOutputDirectory>
       <checkStaleness>true</checkStaleness>
  </configuration>
</plugin>

So the build is failed.

[INFO] --- protobuf-maven-plugin:0.5.0:compile (compile-protoc) @ hbase-protocol-shaded ---
[INFO] Compiling 32 proto file(s) to /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
Failed to execute goal org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.0:compile (compile-protoc) on project hbase-protocol-shaded: Missing:

Then I installed aarch64 protobuf 2.5.0 on the host and modify the pom:

-   <protocArtifact>com.google.protobuf:protoc:${external.protobuf.version}:exe:${os.detected.classifier}</protocArtifact>
+  <protocExecutable>/usr/local/bin/protoc</protocExecutable>

The build is also failed:

[INFO] Compiling 32 proto file(s) to /root/hbase/hbase-protocol-shaded/target/generated-sources/protobuf/java
[ERROR] PROTOC FAILED: google/protobuf/any.proto:31:10: Unrecognized syntax identifier "proto3".  This parser only recognizes "proto2".

It seems that "internal.protobuf.version" in "hbase-protocol-shaded" is 3.3.0.

How to fix it? Thanks!

Issue Links

• blocks: HIVE-20359 Update protobuf version in pom.xml
• relates to: HBASE-16761 Migrate existing protobuf2.5.0 Coprocessor Endpoints (and servers-side hbase) to protobuf3.
• relates to: HBASE-24259 [thirdparty] Update Protobuf to 3.11.4
• links to: GitHub Pull Request #14
• links to: GitHub Pull Request #1186