Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-1861

kudu test loadgen: change default behavior to avoid compactions on tablet servers

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.8.0
    • Component/s: util
    • Labels:
      None

      Description

      In the context of use case to '...generate as many Kudu blocks as possible...', the 'kudu test loadgen' tool can do better job if exercising a load pattern which maximizes throughput and avoids compaction activity on tablet servers.

      In short, the default behavior should change for the auto-created table case, so the tool would:

      1. create a table with N partitions (where n == number of generator threads)
      2. let each worker thread insert sequentially into its own partition

      Current option of having hash-partioned auto-created table should be preserved, but turned off by default. For some test scenarios, it makes sense to exercise data load patterns which involve a lot of compaction activity on the tablet servers.

        Attachments

          Activity

            People

            • Assignee:
              awong Andrew Wong
              Reporter:
              aserbin Alexey Serbin
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: