Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: backlog
    • Fix Version/s: 1.0.0
    • Component/s: blueprints
    • Labels:
      None

      Description

      We've now removed hive (BIGTOP-1270) from the BigPetStore integration tests app. Lets update the arch.dot to reflect the new architecture that will guide BIGTOP-1271 (mainly focused around mapreduce, pig, mahout, and some kind of final sink like hbase/solr).

      Not sure if William Benton has specific ideas for how we will titrate spark into the app yet, but ideas welcome in that area as well.

      1. arch.jpeg
        161 kB
        jay vyas
      2. BIGTOP-1327.patch
        3 kB
        jay vyas

        Issue Links

          Activity

          Hide
          jayunit100 jay vyas added a comment -

          That should do it. I'll attach a jpg also for anyone who doesnt have graphviz installed.

          Show
          jayunit100 jay vyas added a comment - That should do it. I'll attach a jpg also for anyone who doesnt have graphviz installed.
          Hide
          jayunit100 jay vyas added a comment -

          new proposed architecture attached. only major difference is

          • instead of hive, we've moved to just another pig script
          • removed crunch temporarily, since its not in the immediate plans

          So - we are basically trimming down the architecture diagram so it expresses a pipeline which we will actually be supporting within the next month.

          Show
          jayunit100 jay vyas added a comment - new proposed architecture attached. only major difference is instead of hive, we've moved to just another pig script removed crunch temporarily, since its not in the immediate plans So - we are basically trimming down the architecture diagram so it expresses a pipeline which we will actually be supporting within the next month.
          Hide
          cos Konstantin Boudnik added a comment -

          +1

          Show
          cos Konstantin Boudnik added a comment - +1
          Hide
          jayunit100 jay vyas added a comment -

          okay just commited the update. Thanks . bhashit parikh the new diagram i think now fullfills the needs updated roadmap for BIGTOP-1272

          Show
          jayunit100 jay vyas added a comment - okay just commited the update. Thanks . bhashit parikh the new diagram i think now fullfills the needs updated roadmap for BIGTOP-1272

            People

            • Assignee:
              jayunit100 jay vyas
              Reporter:
              jayunit100 jay vyas
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development