Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-3140

Can Avro schema registry be used with flume without including schema url in the event header

    XMLWordPrintableJSON

Details

    • Question
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.7.0
    • None
    • Configuration, Sinks+Sources
    • None

    • Flume1.7

    Description

      I have a data pipeline wherein the data for 4 tables is written to a kafka topic as avro using schema registry. The it is passed to flume using memory channel and using kite dataset want to write to HDFS as parquet data.
      One way is to include the schema url which points to hdfs location in the event header.
      Is there any way to refer the schema registry in the flume.conf file?

      Attachments

        Activity

          People

            Unassigned Unassigned
            ramgopalnaali Ramgopal N
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: