[HADOOP-18031] Build arm64 (aarch64) and x86_64 image with the same Dockerfile

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Target Version/s: 3.3.9
• Assignee: Siyao Meng
• Reporter: Siyao Meng
• Created: 02/Dec/21 10:01
• Updated: 29/Nov/22 15:55

Description

Support building Linux arm64 (aarch64) Docker images. And bump up some dependency versions.

Note: This only provides a arm64 runtime environment for Hadoop 3. But not a full environment for compiling Hadoop 3 in arm64 yet. For the latter, gRPC may well need to be compiled from source because it hasn't started distributing Linux arm64 binaries yet.

The patch for branch-3.3 is ready. I developed this patch on branch-3.3.1 when I was trying to build arm64 Linux Hadoop Docker image. For trunk (3.4.0), due to HADOOP-17727, I need to post a different PR.

Just realized we already had Dockerfile_aarch64. Will try it out.

My approach builds the Docker images for both architectures (x86_64 and aarch64) with the same Dockerfile.

We should push the built arm64 image to Docker Hub. I only see amd64 there so I assumed we didn't have arm64 Docker image, hmm.