Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-1851 Sqoop2: Kafka Connector
  3. SQOOP-1854

Sqoop2: Avro serialization in Kafka Connector

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently the Kafka connector expects to read CSV from Kafka and writes CSV to Kafka.
      Since Avro is pretty much the standard for data in Kafka, it will be nice to support this too.
      We'll want the user to supply a URI where we can store the schema. Will be nice to support both HDFS and the schema-repo.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              gwenshap Gwen Shapira
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: