Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-12637

IgniteSparkSession doesn't start the clients on really distributed cluster

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Cannot Reproduce
    • 2.7.6
    • 2.9, 2.8.1
    • spark
    • None
    • Docs Required, Release Notes Required

    Description

      Next code:

      IgniteSparkSession igniteSession = IgniteSparkSession.builder()
                     .appName("Spark Ignite example")
                     .igniteConfig(configPath)
                     .getOrCreate();

      Throws:

      class org.apache.ignite.IgniteIllegalStateException: Ignite instance with provided name doesn't exist. Did you call Ignition.start(..) to start an Ignite instance? [name=grid]

      Client config was located in all Spark nodes at the same place. 

      When I ran these tests on the same host with several local executors then it worked. But if executors were located on different hosts then it didn't.

      DataFrame API works fine with the same config.

      Attachments

        Issue Links

          Activity

            People

              YAMolochkov Yaroslav Molochkov
              aealeksandrov Andrei Aleksandrov
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: