Uploaded image for project: 'ManifoldCF'
  1. ManifoldCF
  2. CONNECTORS-1162

Apache Kafka Output Connector

    XMLWordPrintableJSON

    Details

    • Type: Wish
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: ManifoldCF 1.8.1, ManifoldCF 2.0.1
    • Fix Version/s: ManifoldCF 2.3
    • Component/s: None
    • Labels:

      Description

      Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system, but with a unique design. A single Kafka broker can handle hundreds of megabytes of reads and writes per second from thousands of clients.

      Apache Kafka is being used for a number of uses cases. One of them is to use Kafka as a feeding system for streaming BigData processes, both in Apache Spark or Hadoop environment. A Kafka output connector could be used for streaming or dispatching crawled documents or metadata and put them in a BigData processing pipeline

        Attachments

        1. 1.JPG
          103 kB
          Tuğba Doğan
        2. 2.JPG
          110 kB
          Tuğba Doğan
        3. Documentation.zip
          2.19 MB
          Tuğba Doğan

          Activity

            People

            • Assignee:
              kwright@metacarta.com Karl Wright
              Reporter:
              rafaharo Rafa Haro
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: