Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.7.0
    • Component/s: None
    • Labels:
      None

      Description

      Flume utilizes the older Kafka producer and consumer APIs. We should add implementations of the Source, Channel and Sink that utilize the new APIs.

        Issue Links

          Activity

          Hide
          ravi.bhattiprolu@gmail.com Ravi Bhattiprolu added a comment -

          Thanks Jeff. Is there any ETA for this ? We are planning to secure(ssl/tls) Kafka - Flume pipeline. Looking forward to this update.
          Thanks.

          Show
          ravi.bhattiprolu@gmail.com Ravi Bhattiprolu added a comment - Thanks Jeff. Is there any ETA for this ? We are planning to secure(ssl/tls) Kafka - Flume pipeline. Looking forward to this update. Thanks.
          Hide
          jholoman Jeff Holoman added a comment -

          There are patches in review for the Sink and Channel, and I understand that the Source is being worked on as well. Unclear on the ETA for the Source, but should be fairly soon.

          Show
          jholoman Jeff Holoman added a comment - There are patches in review for the Sink and Channel, and I understand that the Source is being worked on as well. Unclear on the ETA for the Source, but should be fairly soon.
          Hide
          wpwang Ping Wang added a comment -

          Hi Jeff, the fix version will be 1.7.0? Will there be a patch for released Flume 1.6.0? Looking forward to this update, thanks.

          Show
          wpwang Ping Wang added a comment - Hi Jeff, the fix version will be 1.7.0? Will there be a patch for released Flume 1.6.0? Looking forward to this update, thanks.
          Hide
          jarcec Jarek Jarcec Cecho added a comment -

          Updated channel and sink got several +1s, so I believe that they are ready to be committed. I've asked Ashish Singh from Kafka community to take a look on the source patch. Once that will be done I'll go ahead and commit all those patches at once. As they obviously overlap a bit (overriding root pom.xml the same way), I'll remove the overlap myself and commit that change.

          Show
          jarcec Jarek Jarcec Cecho added a comment - Updated channel and sink got several +1s, so I believe that they are ready to be committed. I've asked Ashish Singh from Kafka community to take a look on the source patch. Once that will be done I'll go ahead and commit all those patches at once. As they obviously overlap a bit (overriding root pom.xml the same way), I'll remove the overlap myself and commit that change.
          Hide
          jarcec Jarek Jarcec Cecho added a comment -

          I'm resolving the umbrella JIRA as all subtasks has been committed.

          Show
          jarcec Jarek Jarcec Cecho added a comment - I'm resolving the umbrella JIRA as all subtasks has been committed.
          Hide
          jasonjwwilliams Jason J. W. Williams added a comment -

          Will this also add TLS/SSL support for the Kafka sink?

          Show
          jasonjwwilliams Jason J. W. Williams added a comment - Will this also add TLS/SSL support for the Kafka sink?
          Hide
          jholoman Jeff Holoman added a comment -

          Yes, this should enable all security features available in the new clients as of 0.9.0.1

          Show
          jholoman Jeff Holoman added a comment - Yes, this should enable all security features available in the new clients as of 0.9.0.1

            People

            • Assignee:
              jholoman Jeff Holoman
              Reporter:
              jholoman Jeff Holoman
            • Votes:
              3 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development