[YARN-10882] Fix branch-3.1 build: zstd library is missing from the Dockerfile

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: build
• Labels: pull-request-available
• Hadoop Flags: Reviewed
• Assignee: Tamas Domok
• Reporter: Tamas Domok
• Created: 11/Aug/21 15:33
• Updated: 12/Aug/21 04:33
• Resolved: 11/Aug/21 16:29

Description

The branch-3.1 did not build on the Jenkins slave, because the zstd is missing from the Dockerfile.

 

[INFO] --- hadoop-maven-plugins:3.1.5-SNAPSHOT:cmake-compile (cmake-compile) @ hadoop-common ---
[INFO] Running cmake /home/jenkins/jenkins-home/workspace/hadoop-multibranch_PR-3286/src/hadoop-common-project/hadoop-common/src -DGENERATED_JAVAH=/home/jenkins/jenkins-home/workspace/hadoop-multibranch_PR-3286/src/hadoop-common-project/hadoop-common/target/native/javah -DJVM_ARCH_DATA_MODEL=64 -DREQUIRE_BZIP2=false -DREQUIRE_ISAL=false -DREQUIRE_OPENSSL=true -DREQUIRE_SNAPPY=true -DREQUIRE_ZSTD=true -G Unix Makefiles
[INFO] with extra environment variables {}
[WARNING] -- The C compiler identification is GNU 7.5.0
[WARNING] -- The CXX compiler identification is GNU 7.5.0
[WARNING] -- Check for working C compiler: /usr/bin/cc
[WARNING] -- Check for working C compiler: /usr/bin/cc -- works
[WARNING] -- Detecting C compiler ABI info
[WARNING] -- Detecting C compiler ABI info - done
[WARNING] -- Detecting C compile features
[WARNING] -- Detecting C compile features - done
[WARNING] -- Check for working CXX compiler: /usr/bin/c++
[WARNING] -- Check for working CXX compiler: /usr/bin/c++ -- works
[WARNING] -- Detecting CXX compiler ABI info
[WARNING] -- Detecting CXX compiler ABI info - done
[WARNING] -- Detecting CXX compile features
[WARNING] -- Detecting CXX compile features - done
[WARNING] -- Looking for pthread.h
[WARNING] -- Looking for pthread.h - found
[WARNING] -- Looking for pthread_create
[WARNING] -- Looking for pthread_create - not found
[WARNING] -- Looking for pthread_create in pthreads
[WARNING] -- Looking for pthread_create in pthreads - not found
[WARNING] -- Looking for pthread_create in pthread
[WARNING] -- Looking for pthread_create in pthread - found
[WARNING] -- Found Threads: TRUE  
[WARNING] JAVA_HOME=, JAVA_JVM_LIBRARY=/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so
[WARNING] JAVA_INCLUDE_PATH=/usr/lib/jvm/java-8-openjdk-amd64/include, JAVA_INCLUDE_PATH2=/usr/lib/jvm/java-8-openjdk-amd64/include/linux
[WARNING] Located all JNI components successfully.
[WARNING] -- Found JNI: /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/libjawt.so  
[WARNING] -- Found ZLIB: /lib/x86_64-linux-gnu/libz.so.1 (found version "1.2.11") 
[WARNING] -- Found Snappy: /usr/lib/x86_64-linux-gnu/libsnappy.so.1
[WARNING] CMake Error at CMakeLists.txt:120 (MESSAGE):
[WARNING]   Required zstandard library could not be found.
[WARNING]   ZSTD_LIBRARY=/usr/lib/x86_64-linux-gnu/libzstd.so.1, ZSTD_INCLUDE_DIR=,
[WARNING]   CUSTOM_ZSTD_INCLUDE_DIR=, CUSTOM_ZSTD_PREFIX=, CUSTOM_ZSTD_INCLUDE= 

Issue Links

• links to: GitHub Pull Request #3297