Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: backlog
    • Fix Version/s: 1.0.0
    • Component/s: blueprints
    • Labels:
      None

      Description

      Jeff Denton at OrangeFS Has created a pull request to generate synthetic data for all 50 states in the union.

      https://github.com/acberk/bigpetstore/blob/903f62fe04b02962a4f97c6f4c9717cd78af1989/src/main/java/org/bigtop/bigpetstore/generator/TransactionIteratorFactory.java

      Shall we role this in as a patch ? Maybe we can do so in a little more sophisticated way (i.e. have the states in a configuration file - this 200 line enum is getting pretty large).

        Issue Links

          Activity

          Hide
          jayunit100 jay vyas added a comment -
          • Resolved via rnowlings new generator in bigpetstore-spark
          • bigpetstore-mapreduce is not being used too much at the moment, but we can port it over to use new generator at some point
          Show
          jayunit100 jay vyas added a comment - Resolved via rnowlings new generator in bigpetstore-spark bigpetstore-mapreduce is not being used too much at the moment, but we can port it over to use new generator at some point
          Hide
          jayunit100 jay vyas added a comment -

          this is dependent on the mahout patch we are working on which updates the way data is generated and embeds more patterns into the data to exersize the recommender.

          Thus we should wait for that mahout update before we add more patterns to the states.

          Show
          jayunit100 jay vyas added a comment - this is dependent on the mahout patch we are working on which updates the way data is generated and embeds more patterns into the data to exersize the recommender. Thus we should wait for that mahout update before we add more patterns to the states.
          Hide
          jayunit100 jay vyas added a comment - - edited

          http://bit.ly/1l9GQRj <-- shortened link

          Show
          jayunit100 jay vyas added a comment - - edited http://bit.ly/1l9GQRj <-- shortened link
          Hide
          jayunit100 jay vyas added a comment -

          The arch.dot diagram has the current roadmap.

          Are you suggesting something else, like a wiki page or something for it to help guide jiras? I'm up for that. But as a bare bones roadmap, arch.dot has the app defined pretty well.

          Currently we only have run the pig and data set generation phases.

          So the first checkpoint will be to accomplish everything in that diagram.

          You can visualize it really easily by pasting "arch.dot" into the online graphviz tool (erdos).

          Show
          jayunit100 jay vyas added a comment - The arch.dot diagram has the current roadmap. Are you suggesting something else, like a wiki page or something for it to help guide jiras? I'm up for that. But as a bare bones roadmap, arch.dot has the app defined pretty well. Currently we only have run the pig and data set generation phases. So the first checkpoint will be to accomplish everything in that diagram. You can visualize it really easily by pasting "arch.dot" into the online graphviz tool (erdos).
          Hide
          cos Konstantin Boudnik added a comment -

          Jay, do you think it would make sense to lay out a road map of some kind for the BigPetStore component? What are we trying to achieve in the end?

          Show
          cos Konstantin Boudnik added a comment - Jay, do you think it would make sense to lay out a road map of some kind for the BigPetStore component? What are we trying to achieve in the end?

            People

            • Assignee:
              rnowling RJ Nowling
              Reporter:
              jayunit100 jay vyas
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development