Uploaded image for project: 'Accumulo'
  1. Accumulo
  2. ACCUMULO-931

Oscillations in Accumulo Ingest Performance

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • 1.4.2
    • None
    • None
    • None

    Description

      Linux 2.6.32, single node, 32 cores, 96 GB RAM, 3x3TB SATA drives, RAID5

      Ingest performance into accumulo varies by 2.5x. Depending upon the number of ingestors.

      Performance tests were carried out using Graph500 benchmark (see d4m_api/examples/3Scaling/2ParallelDatabase/pDB10_EdgeInsertTEST.m from http://www.mit.edu/~kepner/D4M/).

      Attachments

        1. 1ingestor.pdf
          200 kB
          Jeremy Kepner
        2. 2ingestor.pdf
          198 kB
          Jeremy Kepner
        3. 3ingestor.pdf
          227 kB
          Jeremy Kepner
        4. 4ingestor.pdf
          192 kB
          Jeremy Kepner
        5. ingest_performance_explained.pdf
          145 kB
          Eric C. Newton
        6. 1ingestor_1table_1tablet.pdf
          171 kB
          Jeremy Kepner
        7. 1ingestor_1table_2tablet.pdf
          183 kB
          Jeremy Kepner
        8. 1ingestor_1table_4tablet.pdf
          159 kB
          Jeremy Kepner
        9. 2,3,4ingestor_1table_4tablet.pdf
          187 kB
          Jeremy Kepner
        10. 12,r8,r10,r12ingestor_1table_12tablet.pdf
          179 kB
          Jeremy Kepner

        Activity

          People

            Unassigned Unassigned
            kepner Jeremy Kepner
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: