Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-12637

IgniteSparkSession doesn't start the clients on really distributed cluster

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Cannot Reproduce
    • Affects Version/s: 2.7.6
    • Fix Version/s: 2.9, 2.8.1
    • Component/s: spark
    • Labels:
      None
    • Ignite Flags:
      Docs Required, Release Notes Required

      Description

      Next code:

      IgniteSparkSession igniteSession = IgniteSparkSession.builder()
                     .appName("Spark Ignite example")
                     .igniteConfig(configPath)
                     .getOrCreate();

      Throws:

      class org.apache.ignite.IgniteIllegalStateException: Ignite instance with provided name doesn't exist. Did you call Ignition.start(..) to start an Ignite instance? [name=grid]

      Client config was located in all Spark nodes at the same place. 

      When I ran these tests on the same host with several local executors then it worked. But if executors were located on different hosts then it didn't.

      DataFrame API works fine with the same config.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                YAMolochkov Yaroslav Molochkov
                Reporter:
                aealeksandrov Andrey Aleksandrov
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: