Uploaded image for project: 'ManifoldCF'
  1. ManifoldCF
  2. CONNECTORS-1162

Apache Kafka Output Connector

    XMLWordPrintableJSON

Details

    • Wish
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • ManifoldCF 1.8.1, ManifoldCF 2.0.1
    • ManifoldCF 2.3
    • None

    Description

      Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system, but with a unique design. A single Kafka broker can handle hundreds of megabytes of reads and writes per second from thousands of clients.

      Apache Kafka is being used for a number of uses cases. One of them is to use Kafka as a feeding system for streaming BigData processes, both in Apache Spark or Hadoop environment. A Kafka output connector could be used for streaming or dispatching crawled documents or metadata and put them in a BigData processing pipeline

      Attachments

        1. Documentation.zip
          2.19 MB
          Tuğba Doğan
        2. 2.JPG
          110 kB
          Tuğba Doğan
        3. 1.JPG
          103 kB
          Tuğba Doğan

        Activity

          People

            kwright@metacarta.com Karl Wright
            rafaharo Rafa Haro
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: