[IMPALA-10226] Change buildall.sh -notests to invoke a single Make target

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 4.0.0
• Fix Version/s: Impala 4.0.0
• Component/s: Infrastructure
• Target Version: Impala 4.0.0
• Epic Color: ghx-label-8
• Assignee: Joe McDonnell
• Reporter: Joe McDonnell
• Created: 07/Oct/20 22:57
• Updated: 19/Oct/20 21:30
• Resolved: 19/Oct/20 21:30

Description

Currently, running "buildall.sh -notests" boils down to invoking make with multiple targets:

 

  if [[ $BUILD_TESTS -eq 0 ]]; then
    # Specify all the non-test targets
    MAKE_TARGETS="impalad statestored catalogd fesupport loggingsupport ImpalaUdf \
        udasample udfsample"
    if (( build_independent_targets )); then
      MAKE_TARGETS+=" cscope fe tarballs"
    fi
  fi
  ${MAKE_CMD} -j${IMPALA_BUILD_THREADS:-4} ${IMPALA_MAKE_FLAGS} ${MAKE_TARGETS}

Based on the build output, it looks like each make target is invoked individually (with the commands underneath going parallel). This is particularly a problem for impalad (which needs to build the backend) and fe. We want these to run simultaneously, and this limitation prevents that.

We should create a single target that builds all the things needing to be built for -notests. Then, this will be invoking one target and allowing all the pieces go parallel.