Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-3663

Hadoop deployment fails on Fedora 35

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0
    • deployment, hadoop
    • None

    Description

      Deploying Hadoop on Fedora 35 fails with the following error.

      Error: Systemd start for hadoop-hdfs-datanode failed!
      journalctl log for hadoop-hdfs-datanode:
      Apr 11 03:34:07 e8bc80e0e517 systemd[1]: /run/systemd/generator.late/hadoop-hdfs-datanode.service:20: PIDFile= references a path below legacy directory /var/run/, updating /var/run/hadoop-hdfs/hadoop-hdfs-datanode.pid ??? /run/hadoop-hdfs/hadoop-hdfs-datanode.pid; please update the unit file accordingly.
      Apr 11 03:34:07 e8bc80e0e517 systemd[1]: Starting LSB: Hadoop datanode...
      Apr 11 03:34:07 e8bc80e0e517 runuser[673]: pam_unix(runuser:session): session opened for user hdfs(uid=994) by (uid=0)
      Apr 11 03:34:08 e8bc80e0e517 hadoop-hdfs-datanode[674]: WARNING: Use of this script to start HDFS daemons is deprecated.
      Apr 11 03:34:08 e8bc80e0e517 hadoop-hdfs-datanode[674]: WARNING: Attempting to execute replacement "hdfs --daemon start" instead.
      Apr 11 03:34:10 e8bc80e0e517 runuser[673]: pam_unix(runuser:session): session closed for user hdfs
      Apr 11 03:34:15 e8bc80e0e517 hadoop-hdfs-datanode[770]: /etc/redhat-lsb/lsb_pidofproc: line 3: /etc/init.d/functions: No such file or directory
      Apr 11 03:34:15 e8bc80e0e517 hadoop-hdfs-datanode[771]: /etc/redhat-lsb/lsb_pidofproc: line 5: pidofproc: command not found
      Apr 11 03:34:15 e8bc80e0e517 hadoop-hdfs-datanode[772]: /etc/redhat-lsb/lsb_log_message: line 3: /etc/init.d/functions: No such file or directory
      Apr 11 03:34:15 e8bc80e0e517 hadoop-hdfs-datanode[772]: Failed to start Hadoop datanode. Return value: 127
      Apr 11 03:34:15 e8bc80e0e517 hadoop-hdfs-datanode[773]: /etc/redhat-lsb/lsb_log_message: line 16: failure: command not found
      Apr 11 03:34:15 e8bc80e0e517 systemd[1]: hadoop-hdfs-datanode.service: Control process exited, code=exited, status=127/n/a
      Apr 11 03:34:15 e8bc80e0e517 systemd[1]: hadoop-hdfs-datanode.service: Failed with result 'exit-code'.
      Apr 11 03:34:15 e8bc80e0e517 systemd[1]: hadoop-hdfs-datanode.service: Unit process 709 (java) remains running after unit stopped.
      Apr 11 03:34:15 e8bc80e0e517 systemd[1]: Failed to start LSB: Hadoop datanode.
      Apr 11 03:34:15 e8bc80e0e517 systemd[1]: hadoop-hdfs-datanode.service: Consumed 3.743s CPU time.
      

      The hadoop package requires /sbin/service, but it has been moved from the initscripts package to initscripts-service since Fedora 35.
      The former contains /etc/init.d/functions but the latter doen't, so the error above occurred.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            iwasakims Masatake Iwasaki
            sekikn Kengo Seki
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1h
                1h

                Slack

                  Issue deployment