Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1680

[BigPetStore] BPS-Spark Unit tests for transaction generation

    XMLWordPrintableJSON

Details

    • Test
    • Status: Open
    • Major
    • Resolution: Unresolved
    • backlog
    • backlog
    • blueprints
    • None

    Description

      The following code could be split up into a method, i think, and would be greatly served by a companion unit test.
      Its the reference impl of the data generator on spark: i.e. this is where we magically generate all the customer transactions .

      155     val transactionRDD = customerRDD.mapPartitionsWithIndex{
      156       (index, custIter) =>
      157         // Create a new RNG
      158         val seedFactory = new SeedFactory(nextSeed ^ index)
      159         val transactionIter = custIter.map{
      160         customer =>
      161           val products = productBC.value
      162           //Create a new purchasing profile.
      163           val profileGen = new PurchasingProfileGenerator(products, seedFactory)
      164           val profile = profileGen.generate()
      165           val transGen = new TransactionGenerator(customer, profile, storesBC.value, products, seedFact    ory)  
      166           var transactions : List[Transaction] = List()
      167           var transaction = transGen.generate()
      168       
      169           //Create a list of this customer's transactions for the time period
      170           while(transaction.getDateTime() < simulationLength) {
      171             transactions = transaction :: transactions
      172             transaction = transGen.generate()
      173           }
      174           //The final result, we return the list of transactions produced above.
      175       transactions
      176         }
      
      

      Attachments

        Activity

          People

            rnowling R J Nowling
            jayunit100 jay vyas
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: