[HADOOP-17807] Use separate source dir for platform builds

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: build
• Labels: pull-request-available
• Hadoop Flags: Reviewed
• Assignee: Gautham Banasandra
• Reporter: Gautham Banasandra
• Due: 17/Jul/21
• Created: 16/Jul/21 06:08
• Updated: 09/Nov/21 13:46
• Resolved: 26/Jul/21 20:10

Description

The multi-platform build stages run on the checkout of the source directory, one after the other. For those platforms that are marked as optional (Centos 8 and Debian 10 currently), the condition to run CI on the platform is determined by inspecting the git commit history and checking if there's any C++ file/C++ build/platform related changes.

It seems like after YETUS runs on one platform, it's clearing up the git branch information. This is causing the build to not get triggered on the optional platforms. Please note that those platforms not marked optional (Ubuntu focal) isn't affected by this since CI runs for this platform irrespective of any C++ changes.

We can see this in the Jenkins UI page -

CI runs for Centos 8 -

Subsequently, the CI for Debian 10 gets skipped -

However, CI for Ubuntu focal runs since it's not marked as optional -

Thus, we need to ensure that each platform builds on its own copy of the source code checkout so that whatever changes one platform makes doesn't affect the other.

Issue Links

• causes: HADOOP-17904 Test Result Not Working In Jenkins Result
• links to: GitHub Pull Request #3210