[HADOOP-17902] Fix Hadoop build on Debian 10

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: build
• Labels: pull-request-available
• Hadoop Flags: Reviewed
• Assignee: Gautham Banasandra
• Reporter: Gautham Banasandra
• Due: 15/Sep/21
• Created: 08/Sep/21 17:46
• Updated: 09/Nov/21 13:46
• Resolved: 18/Sep/21 18:52

Description

We're using Debian testing as one of the package sources to get the latest packages. It seems to be broken at the moment. The CI fails to create the build environment for the Debian 10 platform -

[2021-09-08T00:21:11.596Z] #13 [ 8/14] RUN apt-get -q update     && apt-get -q install -y --no-install-recommends python3     && apt-get -q install -y --no-install-recommends $(pkg-resolver/resolve.py debian:10)     && apt-get clean     && rm -rf /var/lib/apt/lists/*
...
[2021-09-08T00:21:22.744Z] #13 11.28 Preparing to unpack .../libc6_2.31-17_amd64.deb ...

[2021-09-08T00:21:23.260Z] #13 11.46 Checking for services that may need to be restarted...

[2021-09-08T00:21:23.260Z] #13 11.48 Checking init scripts...

[2021-09-08T00:21:23.260Z] #13 11.50 Unpacking libc6:amd64 (2.31-17) over (2.28-10) ...

[2021-09-08T00:21:26.290Z] #13 14.38 Setting up libc6:amd64 (2.31-17) ...

[2021-09-08T00:21:26.290Z] #13 14.42 /usr/bin/perl: error while loading shared libraries: libcrypt.so.1: cannot open shared object file: No such file or directory

[2021-09-08T00:21:26.290Z] #13 14.42 dpkg: error processing package libc6:amd64 (--configure):

[2021-09-08T00:21:26.290Z] #13 14.42  installed libc6:amd64 package post-installation script subprocess returned error exit status 127

[2021-09-08T00:21:26.291Z] #13 14.43 Errors were encountered while processing:

[2021-09-08T00:21:26.291Z] #13 14.43  libc6:amd64

[2021-09-08T00:21:26.291Z] #13 14.46 E: Sub-process /usr/bin/dpkg returned an error code (1)

[2021-09-08T00:21:27.867Z] #13 ERROR: executor failed running [/bin/bash -o pipefail -c apt-get -q update     && apt-get -q install -y --no-install-recommends python3     && apt-get -q install -y --no-install-recommends $(pkg-resolver/resolve.py debian:10)     && apt-get clean     && rm -rf /var/lib/apt/lists/*]: exit code: 100

[2021-09-08T00:21:27.867Z] ------

[2021-09-08T00:21:27.867Z]  > [ 8/14] RUN apt-get -q update     && apt-get -q install -y --no-install-recommends python3     && apt-get -q install -y --no-install-recommends $(pkg-resolver/resolve.py debian:10)     && apt-get clean     && rm -rf /var/lib/apt/lists/*:

[2021-09-08T00:21:27.867Z] ------

[2021-09-08T00:21:27.867Z] executor failed running [/bin/bash -o pipefail -c apt-get -q update     && apt-get -q install -y --no-install-recommends python3     && apt-get -q install -y --no-install-recommends $(pkg-resolver/resolve.py debian:10)     && apt-get clean     && rm -rf /var/lib/apt/lists/*]: exit code: 100

[2021-09-08T00:21:27.867Z] ERROR: Docker failed to build yetus/hadoop:ef5dbc7283a.

[2021-09-08T00:21:27.867Z] 

The above log lines are copied from - https://ci-hadoop.apache.org/blue/organizations/jenkins/hadoop-multibranch/detail/PR-3388/3/pipeline

Issue Links

• is blocked by: HADOOP-17913 Filter deps with release labels
• links to: GitHub Pull Request #3408