Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: v1.7.0
    • Component/s: None
    • Labels:
      None

      Description

      Flume utilizes the older Kafka producer and consumer APIs. We should add implementations of the Source, Channel and Sink that utilize the new APIs.

        Issue Links

          Activity

          Hide
          Ravi Bhattiprolu added a comment -

          Thanks Jeff. Is there any ETA for this ? We are planning to secure(ssl/tls) Kafka - Flume pipeline. Looking forward to this update.
          Thanks.

          Show
          Ravi Bhattiprolu added a comment - Thanks Jeff. Is there any ETA for this ? We are planning to secure(ssl/tls) Kafka - Flume pipeline. Looking forward to this update. Thanks.
          Hide
          Jeff Holoman added a comment -

          There are patches in review for the Sink and Channel, and I understand that the Source is being worked on as well. Unclear on the ETA for the Source, but should be fairly soon.

          Show
          Jeff Holoman added a comment - There are patches in review for the Sink and Channel, and I understand that the Source is being worked on as well. Unclear on the ETA for the Source, but should be fairly soon.
          Hide
          Ping Wang added a comment -

          Hi Jeff, the fix version will be 1.7.0? Will there be a patch for released Flume 1.6.0? Looking forward to this update, thanks.

          Show
          Ping Wang added a comment - Hi Jeff, the fix version will be 1.7.0? Will there be a patch for released Flume 1.6.0? Looking forward to this update, thanks.
          Hide
          Jarek Jarcec Cecho added a comment -

          Updated channel and sink got several +1s, so I believe that they are ready to be committed. I've asked Ashish K Singh from Kafka community to take a look on the source patch. Once that will be done I'll go ahead and commit all those patches at once. As they obviously overlap a bit (overriding root pom.xml the same way), I'll remove the overlap myself and commit that change.

          Show
          Jarek Jarcec Cecho added a comment - Updated channel and sink got several +1s, so I believe that they are ready to be committed. I've asked Ashish K Singh from Kafka community to take a look on the source patch. Once that will be done I'll go ahead and commit all those patches at once. As they obviously overlap a bit (overriding root pom.xml the same way), I'll remove the overlap myself and commit that change.
          Hide
          Jarek Jarcec Cecho added a comment -

          I'm resolving the umbrella JIRA as all subtasks has been committed.

          Show
          Jarek Jarcec Cecho added a comment - I'm resolving the umbrella JIRA as all subtasks has been committed.
          Hide
          Jason J. W. Williams added a comment -

          Will this also add TLS/SSL support for the Kafka sink?

          Show
          Jason J. W. Williams added a comment - Will this also add TLS/SSL support for the Kafka sink?
          Hide
          Jeff Holoman added a comment -

          Yes, this should enable all security features available in the new clients as of 0.9.0.1

          Show
          Jeff Holoman added a comment - Yes, this should enable all security features available in the new clients as of 0.9.0.1

            People

            • Assignee:
              Jeff Holoman
              Reporter:
              Jeff Holoman
            • Votes:
              3 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development