Uploaded image for project: 'OODT'
  1. OODT
  2. OODT-698

Adapt OODT Process Streaming Data

    XMLWordPrintableJSON

    Details

    • Skill Level:
      Don't Know (Unsure) - The default level

      Description

      Currently OODT excels at managing data, however; it is not as capable of processing really large data sets. The major drawbacks of OODT are: file-based data storage, and filesystem based io. Both of these drawbacks can be addressed by combining OODT with new stream-processing and cluster management technologies.

      This effort is currently focused on combining OODT with the Berkley Data Analysis Stack to achieve these exact results.

      Initial designs are captured in the attached slides. Focus on "Track 2" as this was decided to be the best approach.

        Attachments

        1. BDAS-OODT.pptx
          237 kB
          Michael Starch
        2. msdemo.pptx
          182 kB
          Michael Starch
        3. SOODTforSparkAtHub.pptx
          204 kB
          Michael Starch

          Activity

            People

            • Assignee:
              starchmd@umich.edu Michael Starch
              Reporter:
              starchmd@umich.edu Michael Starch
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 3h 2m
                3h 2m
                Remaining:
                Remaining Estimate - 3h 2m
                3h 2m
                Logged:
                Time Spent - Not Specified
                Not Specified