[BIGTOP-3663] Hadoop deployment fails on Fedora 35

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.1.0
• Component/s: deployment, hadoop
• Assignee: Masatake Iwasaki
• Reporter: Kengo Seki
• Created: 11/Apr/22 05:12
• Updated: 12/Apr/22 05:05
• Resolved: 12/Apr/22 05:05

Description

Deploying Hadoop on Fedora 35 fails with the following error.

Error: Systemd start for hadoop-hdfs-datanode failed!
journalctl log for hadoop-hdfs-datanode:
Apr 11 03:34:07 e8bc80e0e517 systemd[1]: /run/systemd/generator.late/hadoop-hdfs-datanode.service:20: PIDFile= references a path below legacy directory /var/run/, updating /var/run/hadoop-hdfs/hadoop-hdfs-datanode.pid ??? /run/hadoop-hdfs/hadoop-hdfs-datanode.pid; please update the unit file accordingly.
Apr 11 03:34:07 e8bc80e0e517 systemd[1]: Starting LSB: Hadoop datanode...
Apr 11 03:34:07 e8bc80e0e517 runuser[673]: pam_unix(runuser:session): session opened for user hdfs(uid=994) by (uid=0)
Apr 11 03:34:08 e8bc80e0e517 hadoop-hdfs-datanode[674]: WARNING: Use of this script to start HDFS daemons is deprecated.
Apr 11 03:34:08 e8bc80e0e517 hadoop-hdfs-datanode[674]: WARNING: Attempting to execute replacement "hdfs --daemon start" instead.
Apr 11 03:34:10 e8bc80e0e517 runuser[673]: pam_unix(runuser:session): session closed for user hdfs
Apr 11 03:34:15 e8bc80e0e517 hadoop-hdfs-datanode[770]: /etc/redhat-lsb/lsb_pidofproc: line 3: /etc/init.d/functions: No such file or directory
Apr 11 03:34:15 e8bc80e0e517 hadoop-hdfs-datanode[771]: /etc/redhat-lsb/lsb_pidofproc: line 5: pidofproc: command not found
Apr 11 03:34:15 e8bc80e0e517 hadoop-hdfs-datanode[772]: /etc/redhat-lsb/lsb_log_message: line 3: /etc/init.d/functions: No such file or directory
Apr 11 03:34:15 e8bc80e0e517 hadoop-hdfs-datanode[772]: Failed to start Hadoop datanode. Return value: 127
Apr 11 03:34:15 e8bc80e0e517 hadoop-hdfs-datanode[773]: /etc/redhat-lsb/lsb_log_message: line 16: failure: command not found
Apr 11 03:34:15 e8bc80e0e517 systemd[1]: hadoop-hdfs-datanode.service: Control process exited, code=exited, status=127/n/a
Apr 11 03:34:15 e8bc80e0e517 systemd[1]: hadoop-hdfs-datanode.service: Failed with result 'exit-code'.
Apr 11 03:34:15 e8bc80e0e517 systemd[1]: hadoop-hdfs-datanode.service: Unit process 709 (java) remains running after unit stopped.
Apr 11 03:34:15 e8bc80e0e517 systemd[1]: Failed to start LSB: Hadoop datanode.
Apr 11 03:34:15 e8bc80e0e517 systemd[1]: hadoop-hdfs-datanode.service: Consumed 3.743s CPU time.

The hadoop package requires /sbin/service, but it has been moved from the initscripts package to initscripts-service since Fedora 35.
The former contains /etc/init.d/functions but the latter doen't, so the error above occurred.

Issue Links

• links to: GitHub pull request #883