Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-1861

kudu test loadgen: change default behavior to avoid compactions on tablet servers

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.2.0
    • 1.8.0
    • util
    • None

    Description

      In the context of use case to '...generate as many Kudu blocks as possible...', the 'kudu test loadgen' tool can do better job if exercising a load pattern which maximizes throughput and avoids compaction activity on tablet servers.

      In short, the default behavior should change for the auto-created table case, so the tool would:

      1. create a table with N partitions (where n == number of generator threads)
      2. let each worker thread insert sequentially into its own partition

      Current option of having hash-partioned auto-created table should be preserved, but turned off by default. For some test scenarios, it makes sense to exercise data load patterns which involve a lot of compaction activity on the tablet servers.

      Attachments

        Activity

          People

            awong Andrew Wong
            aserbin Alexey Serbin
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: