Uploaded image for project: 'Giraph'
  1. Giraph
  2. GIRAPH-436 Improvement of partition selection for out-of-core graph
  3. GIRAPH-461

Convert static assignment of in-memory partitions with LRU cache

          Details

          • Type: Sub-task
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: None
          • Component/s: graph
          • Labels:
            None

            Description

            Currently, the out-of-core partitions are assigned to memory or to disk statically. Using an LRU cache should help keeping in-memory only the partitions that are actively accessed, given a job that does not access all the graph at each superstep (traversals) and a good data partitioning (non random).

              Attachments

              1. GIRAPH-461.patch
                45 kB
                Claudio Martella
              2. GIRAPH-461.patch
                47 kB
                Claudio Martella
              3. GIRAPH-461.patch
                47 kB
                Claudio Martella

                Issue Links

                relates to

                Bug - A problem which impairs or prevents the functions of the product. GIRAPH-462 Multithreading breaks out-of-core graph

                • Critical - Crashes, loss of data, severe memory leak.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      cmartella Claudio Martella
                      Reporter:
                      cmartella Claudio Martella
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      4 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: