Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-3140

Can Avro schema registry be used with flume without including schema url in the event header

    XMLWordPrintableJSON

    Details

    • Type: Question
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.7.0
    • Fix Version/s: None
    • Labels:
      None
    • Environment:

      Flume1.7

      Description

      I have a data pipeline wherein the data for 4 tables is written to a kafka topic as avro using schema registry. The it is passed to flume using memory channel and using kite dataset want to write to HDFS as parquet data.
      One way is to include the schema url which points to hdfs location in the event header.
      Is there any way to refer the schema registry in the flume.conf file?

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              ramgopalnaali Ramgopal N
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: