Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1492 truly shared cache for jars (jobjar/libjar)
  3. YARN-2944

InMemorySCMStore can not be instantiated with ReflectionUtils#newInstance

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.7.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently the Shared Cache Manager uses ReflectionUtils#newInstance to create the SCMStore service. Unfortunately the SCMStore class does not have a 0-argument constructor.

      On startup, the SCM fails with the following:

      14/12/09 16:10:53 INFO service.AbstractService: Service SharedCacheManager failed in state INITED; cause: java.lang.RuntimeException: java.lang.NoSuchMethodException: org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore.<init>()
      java.lang.RuntimeException: java.lang.NoSuchMethodException: org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore.<init>()
              at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
              at org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager.createSCMStoreService(SharedCacheManager.java:103)
              at org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager.serviceInit(SharedCacheManager.java:65)
              at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
              at org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager.main(SharedCacheManager.java:156)
      Caused by: java.lang.NoSuchMethodException: org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore.<init>()
              at java.lang.Class.getConstructor0(Class.java:2763)
              at java.lang.Class.getDeclaredConstructor(Class.java:2021)
              at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
              ... 4 more
      14/12/09 16:10:53 FATAL sharedcachemanager.SharedCacheManager: Error starting SharedCacheManager
      java.lang.RuntimeException: java.lang.NoSuchMethodException: org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore.<init>()
              at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
              at org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager.createSCMStoreService(SharedCacheManager.java:103)
              at org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager.serviceInit(SharedCacheManager.java:65)
              at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
              at org.apache.hadoop.yarn.server.sharedcachemanager.SharedCacheManager.main(SharedCacheManager.java:156)
      Caused by: java.lang.NoSuchMethodException: org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore.<init>()
              at java.lang.Class.getConstructor0(Class.java:2763)
              at java.lang.Class.getDeclaredConstructor(Class.java:2021)
              at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
              ... 4 more
      

      This JIRA is to add a 0-argument constructor to SCMStore.

        Attachments

        1. YARN-2944-trunk-v3.patch
          17 kB
          Chris Trezzo
        2. YARN-2944-trunk-v2.patch
          13 kB
          Chris Trezzo
        3. YARN-2944-trunk-v1.patch
          6 kB
          Chris Trezzo

          Activity

            People

            • Assignee:
              ctrezzo Chris Trezzo
              Reporter:
              ctrezzo Chris Trezzo
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: