Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2810

Add static Schema URL to AvroEventSerializer configuration

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.7.0
    • Component/s: None
    • Labels:
      None

      Description

      Currently the only way to pass a schema to the avro event serializer is via header. This would introduce an option to specify the location directly in the configuration.

        Issue Links

          Activity

          Hide
          jholoman Jeff Holoman added a comment -

          Jarek Jarcec Cecho, Hari Shreedharan Do you think either of you could do a review of this?

          Thanks

          Jeff

          Show
          jholoman Jeff Holoman added a comment - Jarek Jarcec Cecho , Hari Shreedharan Do you think either of you could do a review of this? Thanks Jeff
          Hide
          jholoman Jeff Holoman added a comment -

          Review Board has been updated based on comments and this patch should be good to go.

          Thanks

          Jeff

          Show
          jholoman Jeff Holoman added a comment - Review Board has been updated based on comments and this patch should be good to go. Thanks Jeff
          Hide
          mpercy Mike Percy added a comment -

          I left a comment on RB but there are still some issues with the docs.

          Show
          mpercy Mike Percy added a comment - I left a comment on RB but there are still some issues with the docs.
          Hide
          mpercy Mike Percy added a comment -

          +1. I am about to commit this.

          Show
          mpercy Mike Percy added a comment - +1. I am about to commit this.
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit dbf2e989744a6b2921076be017102f75323a69f4 in flume's branch refs/heads/trunk from Jeff Holoman
          [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=dbf2e98 ]

          FLUME-2810. Add static Schema URL to AvroEventSerializer configuration

          Currently the only way to pass a schema to the avro event serializer is
          via header. This introduces an option to specify the location directly
          in the Flume configuration.

          (Jeff Holoman via Mike Percy)

          Show
          jira-bot ASF subversion and git services added a comment - Commit dbf2e989744a6b2921076be017102f75323a69f4 in flume's branch refs/heads/trunk from Jeff Holoman [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=dbf2e98 ] FLUME-2810 . Add static Schema URL to AvroEventSerializer configuration Currently the only way to pass a schema to the avro event serializer is via header. This introduces an option to specify the location directly in the Flume configuration. (Jeff Holoman via Mike Percy)
          Hide
          mpercy Mike Percy added a comment -

          Pushed to trunk. Thanks for the patch, Jeff!

          Show
          mpercy Mike Percy added a comment - Pushed to trunk. Thanks for the patch, Jeff!
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Flume-trunk-hbase-1 #181 (See https://builds.apache.org/job/Flume-trunk-hbase-1/181/)
          FLUME-2810. Add static Schema URL to AvroEventSerializer configuration (mpercy: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=dbf2e989744a6b2921076be017102f75323a69f4)

          • flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestAvroEventSerializer.java
          • flume-ng-core/src/main/java/org/apache/flume/serialization/AvroEventSerializerConfigurationConstants.java
          • flume-ng-doc/sphinx/FlumeUserGuide.rst
          • flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/AvroEventSerializer.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Flume-trunk-hbase-1 #181 (See https://builds.apache.org/job/Flume-trunk-hbase-1/181/ ) FLUME-2810 . Add static Schema URL to AvroEventSerializer configuration (mpercy: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=dbf2e989744a6b2921076be017102f75323a69f4 ) flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestAvroEventSerializer.java flume-ng-core/src/main/java/org/apache/flume/serialization/AvroEventSerializerConfigurationConstants.java flume-ng-doc/sphinx/FlumeUserGuide.rst flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/AvroEventSerializer.java

            People

            • Assignee:
              jholoman Jeff Holoman
              Reporter:
              jholoman Jeff Holoman
            • Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development