Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10289

spark on yarn execption

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • 3.0.3
    • None
    • nodemanager
    • None
    • hadoop 3.0.0

    Description

      i execute spark on yarn and get the issue like this:

      stderr96Error: Could not find or load main class org.apache.spark.executor.CoarseGrainedExecutorBackend
      prelaunch.out70Setting up env variables2_000003?
      Setting up job resources
      Launching container
      stderr96Error: Could not find or load main class org.apache.spark.executor.CoarseGrainedExecutorBackend
      stdout0(&container_1590115508504_0033_02_000001╬ęcontainer-localizer-syslog1842020-05-24 15:39:20,867 INFO [main] org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer: Disk Validator: yarn.nodemanager.disk-validator is loaded.
      prelaunch.out70Setting up env variables
      Setting up job resources
      Launching container
      stderr333ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console. Set system property 'org.apache.logging.log4j.simplelog.StatusLogger.level' to TRACE to show Log4j2 internal initialization logging.
      Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
      prelaunch.out70Setting up env variables1_000005?
      Setting up job resources
      Launching container
      stderr96Error: Could not find or load main class org.apache.spark.executor.CoarseGrainedExecutorBackend
      prelaunch.out70Setting up env variables1_000004?
      Setting up job resources
      Launching container
      stderr96Error: Could not find or load main class org.apache.spark.executor.CoarseGrainedExecutorBackend
      stdout0
      VERSION*(&container_1590115508504_0033_01_00000none??data:BCFile.indexnone?

      Attachments

        Activity

          People

            Unassigned Unassigned
            hxe297446118 huang xin
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: