Uploaded image for project: 'Jackrabbit Oak'
  1. Jackrabbit Oak
  2. OAK-5655

TarMK: Analyse locality of reference

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 1.40.0
    • Component/s: segment-tar
    • Labels:

      Description

      We need to better understand the locality aspects of content stored in TarMK:

      • How is related content spread over segments?
      • What content do we consider related?
      • How does locality of related content develop over time when changes are applied?
      • What changes do we consider typical?
      • What is the impact of compaction on locality?
      • What is the impact of the deduplication caches on locality (during normal operation and during compaction)?
      • How good are checkpoints deduplicated? Can we monitor this online?
      • ...

        Attachments

        1. compaction-time-vs.reposize.png
          75 kB
          Michael Dürig
        2. compaction-time-vs-reposize.m
          0.3 kB
          Michael Dürig
        3. data00053a.tar-reads.png
          45 kB
          Michael Dürig
        4. offrc.jfr
          4.07 MB
          Michael Dürig
        5. segment-per-path.png
          6 kB
          Michael Dürig
        6. segment-per-path-compacted.png
          5 kB
          Michael Dürig
        7. segment-per-path-compacted-nocache.png
          5 kB
          Michael Dürig
        8. segment-per-path-compacted-nostringcache.png
          5 kB
          Michael Dürig
        9. segment-reads.png
          223 kB
          Michael Dürig

          Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. OAK-1905 SegmentMK: Arch segment(s)

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. OAK-4558 SegmentNodeState.fastEquals() can trigger two I/O operations

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                mduerig Michael Dürig
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: