Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-2055

Support integrating Streaming table with Spark Streaming

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.4.0, 1.3.1
    • spark-integration
    • None

    Description

      Currently CarbonData just support integrating 
      with Spark Structured Streaming which requires Kafka's version must be >= 
      0.10. But there are still many users  integrating Spark Streaming with 
      kafka 0.8, the cost of upgrading kafka is too 
      much. So CarbonData need to integrate with Spark Streaming too.

      Please see the discussion in mailing list:

      http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/Should-CarbonData-need-to-integrate-with-Spark-Streaming-too-td35341.html 

      Attachments

        Issue Links

          Activity

            People

              zzcclp Zhichao Zhang
              zzcclp Zhichao Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 15h 40m
                  15h 40m