Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1414 Add Apache Spark implementation to BigPetStore
  3. BIGTOP-1535

Add Spark ETL script to BigPetStore

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.0.0
    • blueprints
    • None

    Description

      We should add script that reads the results from the data generator and normalizes the data and splits it into separate tables (ETL). It would be nice to use Spark SQL but it is not required.

      Attachments

        1. bps_spark_etl.patch
          29 kB
          R J Nowling

        Issue Links

          blocks

          Sub-task - The sub-task of the issue BIGTOP-1537 [BigPetStore] Add Spark Product Recommender example

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. BIGTOP-1538 Add customer clustering example to BPS Spark

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. BIGTOP-1539 Add Spark analytics example for distribution of time between customer purchases

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. BIGTOP-1540 Add Spark analytics example for distribution of customer-store and transaction customer-store distances

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. BIGTOP-1536 BPS Spark : Unit test upgrade + Basic Sales Analytics Example.

          • Major - Major loss of function.
          • Closed
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. BIGTOP-1366 Updated, Richer Model for Generating Data for BigPetStore

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is part of

          Improvement - An improvement or enhancement to an existing feature or task. BIGTOP-1414 Add Apache Spark implementation to BigPetStore

          • Major - Major loss of function.
          • Closed

          Activity

            People

              rnowling R J Nowling
              rnowling R J Nowling
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: