Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2810

Add static Schema URL to AvroEventSerializer configuration

        Details

        • Type: Improvement
        • Status: Resolved
        • Priority: Minor
        • Resolution: Fixed
        • Affects Version/s: None
        • Fix Version/s: 1.7.0
        • Component/s: None
        • Labels:
          None

          Description

          Currently the only way to pass a schema to the avro event serializer is via header. This would introduce an option to specify the location directly in the configuration.

            Issue Links

            links to

            Web Link Review board

              Activity

              Ascending order - Click to sort in descending order
              Hide
              Permalink
              jholoman Jeff Holoman added a comment -

              Jarek Jarcec Cecho, Hari Shreedharan Do you think either of you could do a review of this?

              Thanks

              Jeff

              Show
              jholoman Jeff Holoman added a comment - Jarek Jarcec Cecho , Hari Shreedharan Do you think either of you could do a review of this? Thanks Jeff
              Hide
              Permalink
              jholoman Jeff Holoman added a comment -

              Review Board has been updated based on comments and this patch should be good to go.

              Thanks

              Jeff

              Show
              jholoman Jeff Holoman added a comment - Review Board has been updated based on comments and this patch should be good to go. Thanks Jeff
              Hide
              Permalink
              mpercy Mike Percy added a comment -

              I left a comment on RB but there are still some issues with the docs.

              Show
              mpercy Mike Percy added a comment - I left a comment on RB but there are still some issues with the docs.
              Hide
              Permalink
              mpercy Mike Percy added a comment -

              +1. I am about to commit this.

              Show
              mpercy Mike Percy added a comment - +1. I am about to commit this.
              Hide
              Permalink
              jira-bot ASF subversion and git services added a comment -

              Commit dbf2e989744a6b2921076be017102f75323a69f4 in flume's branch refs/heads/trunk from Jeff Holoman
              [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=dbf2e98 ]

              FLUME-2810. Add static Schema URL to AvroEventSerializer configuration

              Currently the only way to pass a schema to the avro event serializer is
              via header. This introduces an option to specify the location directly
              in the Flume configuration.

              (Jeff Holoman via Mike Percy)

              Show
              jira-bot ASF subversion and git services added a comment - Commit dbf2e989744a6b2921076be017102f75323a69f4 in flume's branch refs/heads/trunk from Jeff Holoman [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=dbf2e98 ] FLUME-2810 . Add static Schema URL to AvroEventSerializer configuration Currently the only way to pass a schema to the avro event serializer is via header. This introduces an option to specify the location directly in the Flume configuration. (Jeff Holoman via Mike Percy)
              Hide
              Permalink
              mpercy Mike Percy added a comment -

              Pushed to trunk. Thanks for the patch, Jeff!

              Show
              mpercy Mike Percy added a comment - Pushed to trunk. Thanks for the patch, Jeff!
              Hide
              Permalink
              hudson Hudson added a comment -

              SUCCESS: Integrated in Flume-trunk-hbase-1 #181 (See https://builds.apache.org/job/Flume-trunk-hbase-1/181/)
              FLUME-2810. Add static Schema URL to AvroEventSerializer configuration (mpercy: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=dbf2e989744a6b2921076be017102f75323a69f4)

              • flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestAvroEventSerializer.java
              • flume-ng-core/src/main/java/org/apache/flume/serialization/AvroEventSerializerConfigurationConstants.java
              • flume-ng-doc/sphinx/FlumeUserGuide.rst
              • flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/AvroEventSerializer.java
              Show
              hudson Hudson added a comment - SUCCESS: Integrated in Flume-trunk-hbase-1 #181 (See https://builds.apache.org/job/Flume-trunk-hbase-1/181/ ) FLUME-2810 . Add static Schema URL to AvroEventSerializer configuration (mpercy: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=dbf2e989744a6b2921076be017102f75323a69f4 ) flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestAvroEventSerializer.java flume-ng-core/src/main/java/org/apache/flume/serialization/AvroEventSerializerConfigurationConstants.java flume-ng-doc/sphinx/FlumeUserGuide.rst flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/AvroEventSerializer.java

                People

                • Assignee:
                  jholoman Jeff Holoman
                  Reporter:
                  jholoman Jeff Holoman
                • Votes:
                  1 Vote for this issue
                  Watchers:
                  7 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Development