[HBASE-19042] Oracle Java 8u144 downloader broken in precommit check

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.4.0, 1.3.2, 2.0.0-alpha-4, 2.0.0, 1.2.7
• Component/s: build
• Hadoop Flags: Reviewed
• Release Note: Precommit switched from Oracle JDK 8 to OpenJDK-8.
• Assignee: Duo Zhang
• Reporter: Peter Somogyi
• Created: 18/Oct/17 20:53
• Updated: 19/Apr/19 17:01
• Resolved: 19/Oct/17 21:07

Description

Precommit job fails to install Oracle Java 8 to docker image which is due to Oracle's new Java version, 8u151.

As this thread point out we probably need to upgrade to latest java 8 version: https://ubuntuforums.org/showthread.php?t=2374686

06:45:14 Setting up java-common (0.51) ...
06:45:14 Setting up oracle-java8-installer (8u144-1~webupd8~0) ...
06:45:14 No /var/cache/oracle-jdk8-installer/wgetrc file found.
06:45:14 Creating /var/cache/oracle-jdk8-installer/wgetrc and
06:45:14 using default oracle-java8-installer wgetrc settings for it.
06:45:14 Downloading Oracle Java 8...
06:45:14 --2017-10-18 13:45:14--  http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
06:45:14 Resolving download.oracle.com (download.oracle.com)... 23.59.189.81, 23.59.189.91
06:45:14 Connecting to download.oracle.com (download.oracle.com)|23.59.189.81|:80... connected.
06:45:14 HTTP request sent, awaiting response... 302 Moved Temporarily
06:45:14 Location: https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz [following]
06:45:14 --2017-10-18 13:45:14--  https://edelivery.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz
06:45:14 Resolving edelivery.oracle.com (edelivery.oracle.com)... 23.39.16.136, 2600:1409:a:39e::2d3e, 2600:1409:a:39c::2d3e
06:45:14 Connecting to edelivery.oracle.com (edelivery.oracle.com)|23.39.16.136|:443... connected.
06:45:14 HTTP request sent, awaiting response... 302 Moved Temporarily
06:45:14 Location: http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c [following]
06:45:14 --2017-10-18 13:45:14--  http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/jdk-8u144-linux-x64.tar.gz?AuthParam=1508334434_7da3c9610b0368a45f954cd47d91121c
06:45:14 Connecting to download.oracle.com (download.oracle.com)|23.59.189.81|:80... connected.
06:45:14 HTTP request sent, awaiting response... 404 Not Found
06:45:14 2017-10-18 13:45:14 ERROR 404: Not Found.
06:45:14 
06:45:14 download failed
06:45:14 Oracle JDK 8 is NOT installed.
06:45:14 dpkg: error processing package oracle-java8-installer (--configure):
06:45:14  subprocess installed post-installation script returned error exit status 1
06:45:14 Errors were encountered while processing:
06:45:14  oracle-java8-installer
06:45:29 E: Sub-process /usr/bin/dpkg returned an error code (1)
06:45:29 The command '/bin/sh -c apt-get -q update && apt-get -q install --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 100
06:45:29 
06:45:29 Total Elapsed time:   3m 19s
06:45:29 
06:45:29 ERROR: Docker failed to build image.

Workaround mentioned in the forum post:

sudo sed -i 's|JAVA_VERSION=8u144|JAVA_VERSION=8u152|' oracle-java8-installer.*
sudo sed -i 's|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u144-b01/090f390dda5b47b9b721c7dfaa008135/|PARTNER_URL=http://download.oracle.com/otn-pub/java/jdk/8u152-b16/aa0333dd3019491ca4f6ddbe78cdb6d0/|' oracle-java8-installer.*
sudo sed -i 's|SHA256SUM_TGZ="e8a341ce566f32c3d06f6d0f0eeea9a0f434f538d22af949ae58bc86f2eeaae4"|SHA256SUM_TGZ="218b3b340c3f6d05d940b817d0270dfe0cfd657a636bad074dcabe0c111961bf"|' oracle-java8-installer.*
sudo sed -i 's|J_DIR=jdk1.8.0_144|J_DIR=jdk1.8.0_152|' oracle-java8-installer.*

Issue Links

• blocks: HBASE-19014 surefire fails; When writing xml report stdout/stderr ... No such file or directory
• breaks: HBASE-19058 The wget isn't installed in building docker image
• relates to: HBASE-19055 Backport HBASE-19042 to other active branches