Uploaded image for project: 'REEF (Retired)'
  1. REEF (Retired)
  2. REEF-58

Add support for YARN SCM

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • REEF-Runtime-YARN
    • None

    Description

      YARN-1492 is being worked on to introduce SCM, which speeds up job launch time by caching shared jars.

      We can incorporate SCM Client logic into reef-runtime-yarn, speeding up REEF job launch time for those who use SCM.

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. YARN-1492 truly shared cache for jars (jobjar/libjar)

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              johnyangk John Yang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: