Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1492 truly shared cache for jars (jobjar/libjar)
  3. YARN-2944

InMemorySCMStore can not be instantiated with ReflectionUtils#newInstance

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 2.7.0
    • None
    • None
    • Reviewed

    Description

      Currently the Shared Cache Manager uses ReflectionUtils#newInstance to create the SCMStore service. Unfortunately the SCMStore class does not have a 0-argument constructor.

      On startup, the SCM fails with the following:

      14/12/09 16:10:53 INFO service.AbstractService: Service SharedCacheManager failed in state INITED; cause: java.lang.RuntimeException: java.lang.NoSuchMethodException: org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore.<init>()
      java.lang.RuntimeException: java.lang.NoSuchMethodException: org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore.<init>()
              at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
              at org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager.createSCMStoreService(SharedCacheManager.java:103)
              at org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager.serviceInit(SharedCacheManager.java:65)
              at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
              at org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager.main(SharedCacheManager.java:156)
      Caused by: java.lang.NoSuchMethodException: org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore.<init>()
              at java.lang.Class.getConstructor0(Class.java:2763)
              at java.lang.Class.getDeclaredConstructor(Class.java:2021)
              at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
              ... 4 more
      14/12/09 16:10:53 FATAL sharedcachemanager.SharedCacheManager: Error starting SharedCacheManager
      java.lang.RuntimeException: java.lang.NoSuchMethodException: org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore.<init>()
              at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
              at org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager.createSCMStoreService(SharedCacheManager.java:103)
              at org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager.serviceInit(SharedCacheManager.java:65)
              at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
              at org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager.main(SharedCacheManager.java:156)
      Caused by: java.lang.NoSuchMethodException: org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore.<init>()
              at java.lang.Class.getConstructor0(Class.java:2763)
              at java.lang.Class.getDeclaredConstructor(Class.java:2021)
              at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
              ... 4 more
      

      This JIRA is to add a 0-argument constructor to SCMStore.

      Attachments

        1. YARN-2944-trunk-v1.patch
          6 kB
          Chris Trezzo
        2. YARN-2944-trunk-v2.patch
          13 kB
          Chris Trezzo
        3. YARN-2944-trunk-v3.patch
          17 kB
          Chris Trezzo

        Activity

          People

            ctrezzo Chris Trezzo
            ctrezzo Chris Trezzo
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: