Uploaded image for project: 'cTAKES'
  1. cTAKES
  2. CTAKES-331

Add persistence layer to SparkStreaming

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • ctakes-clinical-pipeline
    • None

    Description

      With the ability to grab tweets and process them scalable w/ SparkStreaming, we now should get a persistence layer - so that we can query data after it is ingested.

      I can create a sink interfaces w/ a few options (solr,cassandra,...) for local processing, and then we can refactor the CTakes portion of the pipeline to run asynchronously to ingest.

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. CTAKES-314 BigTop/Hadoop cTAKES integration

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              jayunit100 jay vyas
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: