Uploaded image for project: 'Accumulo'
  1. Accumulo
  2. ACCUMULO-3282 Reduce scans of metadata when assigning tablet
  3. ACCUMULO-3327

tablet server re-reads the bulk loaded flags with every bulk import request

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.5.1, 1.6.0, 1.6.1
    • 1.8.0
    • tserver
    • None

    Description

      On a very large cluster, which bulk loads many thousands of files every few minutes, I noticed the servers would reload the bulk imported flags with every request. This put a lot of pressure on the accumulo.metadata table, and it just isn't necessary: the tablet should be tracking which bulk import files it has loaded, except when it first loaded.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. ACCUMULO-4430 FastBulkImportIT does not always pass

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              ecn Eric C. Newton
              ecn Eric C. Newton
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m