[IMPALA-10828] Impala 4.0 should pin to a specifit toolchain commit when building on ARM

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 4.0.0
• Fix Version/s: Impala 4.0.1
• Component/s: Infrastructure
• Environment: aarch64
• Target Version: Impala 4.0.1
• Epic Color: ghx-label-9
• Assignee: Quanlong Huang
• Reporter: Quanlong Huang
• Created: 27/Jul/21 11:08
• Updated: 27/Sep/21 09:52
• Resolved: 27/Sep/21 09:52

Description

While building on ARM platform, bin/bootstrap_system.sh will compile native-toolchain:

if [[ $ARCH_NAME == 'aarch64' ]]; then
  echo -e "\nexport SKIP_TOOLCHAIN_BOOTSTRAP=true" >> \
    "${IMPALA_HOME}/bin/impala-config-local.sh"
  SET_TOOLCHAIN_HOME="export NATIVE_TOOLCHAIN_HOME=${IMPALA_HOME}/../native-toolchain"
  echo -e "\n$SET_TOOLCHAIN_HOME" >> ~/.bashrc
  echo -e "\n$SET_TOOLCHAIN_HOME" >> "${IMPALA_HOME}/bin/impala-config-local.sh"
  eval "$SET_TOOLCHAIN_HOME"
  if ! [[ -d "$NATIVE_TOOLCHAIN_HOME" ]]; then
    time -p git clone https://github.com/cloudera/native-toolchain/ \
      "$NATIVE_TOOLCHAIN_HOME"
  fi
  cd "$NATIVE_TOOLCHAIN_HOME"
  git pull
  echo "Begin build tool chain, may need several hours, please be patient...."
  sudo chmod 755 ~/.cache
  ./buildall.sh
  cd -
  mkdir -p ${IMPALA_HOME}/toolchain
fi 

However, it checks out the master branch of native-toolchain, which will result in compile errors. The corresponding commit should be 701500a90f2539a1d3f4ef3fe7546135b670f0a5.