Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1912

possible bug for spark-slave?

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • backlog, 0.8.0
    • None
    • vm
    • None
    • centos 6, openstack

    Description

      I saw this error when I'm running vagrant-puppet on openstack (see BIGTOP-1911 for patch detail)
      Spark worked on master node, but not on slave node. It might be a puppet problem or a networking problem because spark randomly choose ports? The fact that it worked in master node made it looks like spark-master is doing some configuration for spark-slave and when in the slave node spark-master is not running, spark-slave breaks.

      I set /etc/hosts with ip address and fully domain name of the host

      ==> hadoop-bigtop2: Error: Could not find resource 'Service[spark-master]' for relationship on 'Service[spark-worker]' on node hadoop-bigtop2.csail.mit.edu
      ==> hadoop-bigtop2: Error: Could not find resource 'Service[spark-master]' for relationship on 'Service[spark-worker]' on node hadoop-bigtop2.csail.mit.edu
      An unknow error happened in Vagrant OpenStack provider
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            mylu Minying Lu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: