Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      This ticket is about adding a new sink for Redis

        Issue Links

          Activity

          Hide
          Bruno Mahé added a comment - - edited

          Here is a new sink for Redis.
          It includes unit tests (87.4% coverage of the code by the unit tests) and has been tested on some real instances of Apache Flume and Redis.
          It is also able to serialize to Logstash format through jackson or to any format since the serializer can be provided through Apache Flume configuration.

          There are a few things I would like to improve on the current patch, but I would rather have this reviewed first before the patch gets really big.

          Show
          Bruno Mahé added a comment - - edited Here is a new sink for Redis. It includes unit tests (87.4% coverage of the code by the unit tests) and has been tested on some real instances of Apache Flume and Redis. It is also able to serialize to Logstash format through jackson or to any format since the serializer can be provided through Apache Flume configuration. There are a few things I would like to improve on the current patch, but I would rather have this reviewed first before the patch gets really big.
          Hide
          Ashish Paliwal added a comment -

          Can you add doc changes to the patch? Meanwhile I shall try out the sink.

          Show
          Ashish Paliwal added a comment - Can you add doc changes to the patch? Meanwhile I shall try out the sink.
          Hide
          Bruno Mahé added a comment -

          Thanks a lot!

          Sure I will add some doc, but I would like to ensure first that I am on the right track.
          I would like to avoid having to update code AND doc in case there are a lot of things to change.
          In the mean time, I can provide an example configuration if it helps.

          Show
          Bruno Mahé added a comment - Thanks a lot! Sure I will add some doc, but I would like to ensure first that I am on the right track. I would like to avoid having to update code AND doc in case there are a lot of things to change. In the mean time, I can provide an example configuration if it helps.
          Hide
          Ashish Paliwal added a comment -

          Got it. With doc changes I meant User Guide changes.

          Show
          Ashish Paliwal added a comment - Got it. With doc changes I meant User Guide changes.
          Hide
          Bruno Mahé added a comment - - edited

          Since then, I fixed and added a few things (added a source among other things).
          So I am removing the patch since it is out of date and misleading.

          Right now this redis source/sink has also become a Flume plugin, so re-creating a patch for Apache Flume will take me some time. So before spending some time on it, I will wait for the outcome of the current discussion regarding the features bloat.
          In the mean time I will see if I can put the current state of this work on github or something.

          Show
          Bruno Mahé added a comment - - edited Since then, I fixed and added a few things (added a source among other things). So I am removing the patch since it is out of date and misleading. Right now this redis source/sink has also become a Flume plugin, so re-creating a patch for Apache Flume will take me some time. So before spending some time on it, I will wait for the outcome of the current discussion regarding the features bloat. In the mean time I will see if I can put the current state of this work on github or something.
          Hide
          Ashish Paliwal added a comment -

          Bruno Mahé Is it possible to get the patch or plugin source. I would like to give it a try.

          Show
          Ashish Paliwal added a comment - Bruno Mahé Is it possible to get the patch or plugin source. I would like to give it a try.
          Hide
          Bruno Mahé added a comment -

          Sure. As soon as I can.

          Show
          Bruno Mahé added a comment - Sure. As soon as I can.
          Hide
          Bruno Mahé added a comment -

          Closing as WONT FIX since the Apache Flume community is not interested in additional components.

          Show
          Bruno Mahé added a comment - Closing as WONT FIX since the Apache Flume community is not interested in additional components.

            People

            • Assignee:
              Bruno Mahé
              Reporter:
              Bruno Mahé
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development