Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-186 Implement unsupported RDD persistence option
  3. NEMO-6

Support RDD caching

    XMLWordPrintableJSON

Details

    Description

      Support RDD caching specified in Spark user programs.
      We'll probably have to extend the current block management modules to support cache evictions. Otherwise, trying to cache large data in memory will result in OOMs.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. NEMO-56 Cache broadcasted data

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Umbrella - An overarching type made of sub-tasks NEMO-15 Run Java Spark ALS in distributed mode

          • Major - Major loss of function.
          • Resolved

          Umbrella - An overarching type made of sub-tasks NEMO-158 Support Spark SQL Example

          • Major - Major loss of function.
          • Resolved
          contains

          Improvement - An improvement or enhancement to an existing feature or task. NEMO-139 Logic in the scheduler for appending jobs

          • Major - Major loss of function.
          • Resolved
          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. NEMO-62 Support Multiple DAGs Submission in a Single User Program

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. NEMO-152 Support Multiple DAGs Execution in a Single User Program

          • Major - Major loss of function.
          • Resolved
          Is contained by

          New Feature - A new feature of the product, which has yet to be developed. NEMO-92 Implement the unimplemented transformations/actions & dataset initialization methods for Spark frontend

          • Major - Major loss of function.
          • Open
          is part of

          Task - A task that needs to be done. NEMO-143 Release v0.1

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              sanha Sanha Lee
              johnyangk John Yang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: