We have an example of using BPS to generate data for spark.
A more realistic thing, however, which is increasingly important, is streaming data.
So, I would like to now add in https://github.com/jayunit100/PetStoreLoadGenerator/ as a direct project inside the bigtop-bigpetstore repository. Its essentially a way to generate (1) HTTP load or (2) Disk load using the existing BigPetStore data generation algorithm.
Im tagging this as 0.9, because I think its a great feature to release with. I can create a patch this week. It will be a good way, for example, to do scale tests of flume and kafka.
Open to ideas/opinions on this.