Flume
  1. Flume
  2. FLUME-2810

Add static Schema URL to AvroEventSerializer configuration

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v1.7.0
    • Component/s: None
    • Labels:
      None

      Description

      Currently the only way to pass a schema to the avro event serializer is via header. This would introduce an option to specify the location directly in the configuration.

        Issue Links

          Activity

          Hide
          Jeff Holoman added a comment -

          Jarek Jarcec Cecho, Hari Shreedharan Do you think either of you could do a review of this?

          Thanks

          Jeff

          Show
          Jeff Holoman added a comment - Jarek Jarcec Cecho , Hari Shreedharan Do you think either of you could do a review of this? Thanks Jeff
          Hide
          Jeff Holoman added a comment -

          Review Board has been updated based on comments and this patch should be good to go.

          Thanks

          Jeff

          Show
          Jeff Holoman added a comment - Review Board has been updated based on comments and this patch should be good to go. Thanks Jeff
          Hide
          Mike Percy added a comment -

          I left a comment on RB but there are still some issues with the docs.

          Show
          Mike Percy added a comment - I left a comment on RB but there are still some issues with the docs.
          Hide
          Mike Percy added a comment -

          +1. I am about to commit this.

          Show
          Mike Percy added a comment - +1. I am about to commit this.
          Hide
          ASF subversion and git services added a comment -

          Commit dbf2e989744a6b2921076be017102f75323a69f4 in flume's branch refs/heads/trunk from Jeff Holoman
          [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=dbf2e98 ]

          FLUME-2810. Add static Schema URL to AvroEventSerializer configuration

          Currently the only way to pass a schema to the avro event serializer is
          via header. This introduces an option to specify the location directly
          in the Flume configuration.

          (Jeff Holoman via Mike Percy)

          Show
          ASF subversion and git services added a comment - Commit dbf2e989744a6b2921076be017102f75323a69f4 in flume's branch refs/heads/trunk from Jeff Holoman [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=dbf2e98 ] FLUME-2810 . Add static Schema URL to AvroEventSerializer configuration Currently the only way to pass a schema to the avro event serializer is via header. This introduces an option to specify the location directly in the Flume configuration. (Jeff Holoman via Mike Percy)
          Hide
          Mike Percy added a comment -

          Pushed to trunk. Thanks for the patch, Jeff!

          Show
          Mike Percy added a comment - Pushed to trunk. Thanks for the patch, Jeff!
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Flume-trunk-hbase-1 #181 (See https://builds.apache.org/job/Flume-trunk-hbase-1/181/)
          FLUME-2810. Add static Schema URL to AvroEventSerializer configuration (mpercy: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=dbf2e989744a6b2921076be017102f75323a69f4)

          • flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestAvroEventSerializer.java
          • flume-ng-core/src/main/java/org/apache/flume/serialization/AvroEventSerializerConfigurationConstants.java
          • flume-ng-doc/sphinx/FlumeUserGuide.rst
          • flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/AvroEventSerializer.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Flume-trunk-hbase-1 #181 (See https://builds.apache.org/job/Flume-trunk-hbase-1/181/ ) FLUME-2810 . Add static Schema URL to AvroEventSerializer configuration (mpercy: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=dbf2e989744a6b2921076be017102f75323a69f4 ) flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestAvroEventSerializer.java flume-ng-core/src/main/java/org/apache/flume/serialization/AvroEventSerializerConfigurationConstants.java flume-ng-doc/sphinx/FlumeUserGuide.rst flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/AvroEventSerializer.java

            People

            • Assignee:
              Jeff Holoman
              Reporter:
              Jeff Holoman
            • Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development