Accumulo
  1. Accumulo
  2. ACCUMULO-931

Oscillations in Accumulo Ingest Performance

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Not A Problem
    • Affects Version/s: 1.4.2
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Linux 2.6.32, single node, 32 cores, 96 GB RAM, 3x3TB SATA drives, RAID5

      Ingest performance into accumulo varies by 2.5x. Depending upon the number of ingestors.

      Performance tests were carried out using Graph500 benchmark (see d4m_api/examples/3Scaling/2ParallelDatabase/pDB10_EdgeInsertTEST.m from http://www.mit.edu/~kepner/D4M/).

      1. 12,r8,r10,r12ingestor_1table_12tablet.pdf
        179 kB
        Jeremy Kepner
      2. 1ingestor_1table_1tablet.pdf
        171 kB
        Jeremy Kepner
      3. 1ingestor_1table_2tablet.pdf
        183 kB
        Jeremy Kepner
      4. 1ingestor_1table_4tablet.pdf
        159 kB
        Jeremy Kepner
      5. 1ingestor.pdf
        200 kB
        Jeremy Kepner
      6. 2,3,4ingestor_1table_4tablet.pdf
        187 kB
        Jeremy Kepner
      7. 2ingestor.pdf
        198 kB
        Jeremy Kepner
      8. 3ingestor.pdf
        227 kB
        Jeremy Kepner
      9. 4ingestor.pdf
        192 kB
        Jeremy Kepner
      10. ingest_performance_explained.pdf
        145 kB
        Eric Newton

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Unassigned
            Reporter:
            Jeremy Kepner
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development