[SPARK-17944] sbin/start-* scripts use of `hostname -f` fail with Solaris

• Type: Bug
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 2.0.1
• Fix Version/s: 2.1.0
• Component/s: Deploy

Environment

Solaris 10, Solaris 11

• Assignee: Erik O'Shaughnessy
• Reporter: Erik O'Shaughnessy
• Created: 14/Oct/16 19:34
• Updated: 22/Oct/16 08:38
• Resolved: 22/Oct/16 08:38

Description

$SPARK_HOME/sbin/start-master.sh fails:

$ ./start-master.sh 
usage: hostname [[-t] system_name]
       hostname [-D]
starting org.apache.spark.deploy.master.Master, logging to /home/eoshaugh/local/spark/logs/spark-eoshaugh-org.apache.spark.deploy.master.Master-1-m7-16-002-ld1.out
failed to launch org.apache.spark.deploy.master.Master:
    --properties-file FILE Path to a custom Spark properties file.
                           Default is conf/spark-defaults.conf.
full log in /home/eoshaugh/local/spark/logs/spark-eoshaugh-org.apache.spark.deploy.master.Master-1-m7-16-002-ld1.out

I found SPARK-17546 which changed the invocation of hostname in sbin/start-master.sh, sbin/start-slaves.sh and sbin/start-mesos-dispatcher.sh to include the flag -f, which is not a valid command line option for the Solaris hostname implementation.

As a workaround, Solaris users can substitute:

`/usr/sbin/check-hostname | awk '{print $NF}'`

Admittedly not an obvious fix, but it provides equivalent functionality.

Issue Links

• links to: [Github] Pull Request #15557 (JnyJny)