Uploaded image for project: 'Crunch (Retired)'
  1. Crunch (Retired)
  2. CRUNCH-606

Create a KafkaSource

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.15.0
    • IO
    • None

    Description

      Pulling data out of Kafka is a common use case and some of the ways to do it Kafka Connect, Camus, Gobblin do not integrate nicely with existing processing pipelines like Crunch. With Kafka 0.9, the consuming API is a lot easier so we should build a Source implementation that can read from Kafka.

      Attachments

        1. CRUNCH-606.diff
          136 kB
          Micah Whitacre
        2. CRUNCH-606.patch
          105 kB
          Micah Whitacre
        3. CRUNCH-606b.diff
          153 kB
          Micah Whitacre
        4. CRUNCH-606-byteswritable.diff
          137 kB
          Micah Whitacre
        5. CRUNCH-606-byteswritable-singleuse.diff
          138 kB
          Micah Whitacre
        6. CRUNCH-606-final.patch
          157 kB
          Micah Whitacre

        Activity

          People

            mkwhitacre Micah Whitacre
            mkwhitacre Micah Whitacre
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: