Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10289

spark on yarn execption

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Invalid
    • Affects Version/s: 3.0.3
    • Fix Version/s: None
    • Component/s: nodemanager
    • Labels:
      None
    • Environment:

      hadoop 3.0.0

      Description

      i execute spark on yarn and get the issue like this:

      stderr96Error: Could not find or load main class org.apache.spark.executor.CoarseGrainedExecutorBackend
      prelaunch.out70Setting up env variables2_000003?
      Setting up job resources
      Launching container
      stderr96Error: Could not find or load main class org.apache.spark.executor.CoarseGrainedExecutorBackend
      stdout0(&container_1590115508504_0033_02_000001╬ęcontainer-localizer-syslog1842020-05-24 15:39:20,867 INFO [main] org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer: Disk Validator: yarn.nodemanager.disk-validator is loaded.
      prelaunch.out70Setting up env variables
      Setting up job resources
      Launching container
      stderr333ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console. Set system property 'org.apache.logging.log4j.simplelog.StatusLogger.level' to TRACE to show Log4j2 internal initialization logging.
      Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
      prelaunch.out70Setting up env variables1_000005?
      Setting up job resources
      Launching container
      stderr96Error: Could not find or load main class org.apache.spark.executor.CoarseGrainedExecutorBackend
      prelaunch.out70Setting up env variables1_000004?
      Setting up job resources
      Launching container
      stderr96Error: Could not find or load main class org.apache.spark.executor.CoarseGrainedExecutorBackend
      stdout0
      VERSION*(&container_1590115508504_0033_01_00000none??data:BCFile.indexnone?

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              hxe297446118 huang xin
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: