Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-4295 Introduce Streamer tool for Carbondata
  3. CARBONDATA-4305

Support Carbondata Streamer tool to fetch data incrementally and merge

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • None
    • None

    Description

      Support a Spark streaming application that basically fetches new incremental data from sources like kafka and DFS and does deduplication and merge the changes onto the target carbondata table.

      Attachments

        Activity

          People

            akashrn5 Akash R Nilugal
            akashrn5 Akash R Nilugal
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 16h 10m
                16h 10m