Uploaded image for project: 'Accumulo'
  1. Accumulo
  2. ACCUMULO-931

Oscillations in Accumulo Ingest Performance

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Problem
    • Affects Version/s: 1.4.2
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Linux 2.6.32, single node, 32 cores, 96 GB RAM, 3x3TB SATA drives, RAID5

      Ingest performance into accumulo varies by 2.5x. Depending upon the number of ingestors.

      Performance tests were carried out using Graph500 benchmark (see d4m_api/examples/3Scaling/2ParallelDatabase/pDB10_EdgeInsertTEST.m from http://www.mit.edu/~kepner/D4M/).

        Attachments

        1. ingest_performance_explained.pdf
          145 kB
          Eric Newton
        2. 4ingestor.pdf
          192 kB
          Jeremy Kepner
        3. 3ingestor.pdf
          227 kB
          Jeremy Kepner
        4. 2ingestor.pdf
          198 kB
          Jeremy Kepner
        5. 2,3,4ingestor_1table_4tablet.pdf
          187 kB
          Jeremy Kepner
        6. 1ingestor.pdf
          200 kB
          Jeremy Kepner
        7. 1ingestor_1table_4tablet.pdf
          159 kB
          Jeremy Kepner
        8. 1ingestor_1table_2tablet.pdf
          183 kB
          Jeremy Kepner
        9. 1ingestor_1table_1tablet.pdf
          171 kB
          Jeremy Kepner
        10. 12,r8,r10,r12ingestor_1table_12tablet.pdf
          179 kB
          Jeremy Kepner

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              kepner Jeremy Kepner
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: