Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Sinks+Sources
    • Labels:
      None

      Description

      This ticket is about adding a new sink for Redis

        Issue Links

          Activity

          Hide
          bmahe Bruno Mahé added a comment - - edited

          Here is a new sink for Redis.
          It includes unit tests (87.4% coverage of the code by the unit tests) and has been tested on some real instances of Apache Flume and Redis.
          It is also able to serialize to Logstash format through jackson or to any format since the serializer can be provided through Apache Flume configuration.

          There are a few things I would like to improve on the current patch, but I would rather have this reviewed first before the patch gets really big.

          Show
          bmahe Bruno Mahé added a comment - - edited Here is a new sink for Redis. It includes unit tests (87.4% coverage of the code by the unit tests) and has been tested on some real instances of Apache Flume and Redis. It is also able to serialize to Logstash format through jackson or to any format since the serializer can be provided through Apache Flume configuration. There are a few things I would like to improve on the current patch, but I would rather have this reviewed first before the patch gets really big.
          Hide
          paliwalashish Ashish Paliwal added a comment -

          Can you add doc changes to the patch? Meanwhile I shall try out the sink.

          Show
          paliwalashish Ashish Paliwal added a comment - Can you add doc changes to the patch? Meanwhile I shall try out the sink.
          Hide
          bmahe Bruno Mahé added a comment -

          Thanks a lot!

          Sure I will add some doc, but I would like to ensure first that I am on the right track.
          I would like to avoid having to update code AND doc in case there are a lot of things to change.
          In the mean time, I can provide an example configuration if it helps.

          Show
          bmahe Bruno Mahé added a comment - Thanks a lot! Sure I will add some doc, but I would like to ensure first that I am on the right track. I would like to avoid having to update code AND doc in case there are a lot of things to change. In the mean time, I can provide an example configuration if it helps.
          Hide
          paliwalashish Ashish Paliwal added a comment -

          Got it. With doc changes I meant User Guide changes.

          Show
          paliwalashish Ashish Paliwal added a comment - Got it. With doc changes I meant User Guide changes.
          Hide
          bmahe Bruno Mahé added a comment - - edited

          Since then, I fixed and added a few things (added a source among other things).
          So I am removing the patch since it is out of date and misleading.

          Right now this redis source/sink has also become a Flume plugin, so re-creating a patch for Apache Flume will take me some time. So before spending some time on it, I will wait for the outcome of the current discussion regarding the features bloat.
          In the mean time I will see if I can put the current state of this work on github or something.

          Show
          bmahe Bruno Mahé added a comment - - edited Since then, I fixed and added a few things (added a source among other things). So I am removing the patch since it is out of date and misleading. Right now this redis source/sink has also become a Flume plugin, so re-creating a patch for Apache Flume will take me some time. So before spending some time on it, I will wait for the outcome of the current discussion regarding the features bloat. In the mean time I will see if I can put the current state of this work on github or something.
          Hide
          paliwalashish Ashish Paliwal added a comment -

          Bruno Mahé Is it possible to get the patch or plugin source. I would like to give it a try.

          Show
          paliwalashish Ashish Paliwal added a comment - Bruno Mahé Is it possible to get the patch or plugin source. I would like to give it a try.
          Hide
          bmahe Bruno Mahé added a comment -

          Sure. As soon as I can.

          Show
          bmahe Bruno Mahé added a comment - Sure. As soon as I can.
          Hide
          bmahe Bruno Mahé added a comment -

          Closing as WONT FIX since the Apache Flume community is not interested in additional components.

          Show
          bmahe Bruno Mahé added a comment - Closing as WONT FIX since the Apache Flume community is not interested in additional components.

            People

            • Assignee:
              bmahe Bruno Mahé
              Reporter:
              bmahe Bruno Mahé
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development