Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1173

Using Vagrant to get up and running with Apache Kafka

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.0.0
    • Component/s: None
    • Labels:
      None

      Description

      Vagrant has been getting a lot of pickup in the tech communities. I have found it very useful for development and testing and working with a few clients now using it to help virtualize their environments in repeatable ways.

      Using Vagrant to get up and running.

      For 0.8.0 I have a patch on github https://github.com/stealthly/kafka

      1) Install Vagrant http://www.vagrantup.com/(http://www.vagrantup.com/)
      2) Install Virtual Box https://www.virtualbox.org/(https://www.virtualbox.org/)

      In the main kafka folder

      1) ./sbt update
      2) ./sbt package
      3) ./sbt assembly-package-dependency
      4) vagrant up

      once this is done

      • Zookeeper will be running 192.168.50.5
      • Broker 1 on 192.168.50.10
      • Broker 2 on 192.168.50.20
      • Broker 3 on 192.168.50.30

      When you are all up and running you will be back at a command brompt.

      If you want you can login to the machines using vagrant shh <machineName> but you don't need to.

      You can access the brokers and zookeeper by their IP

      e.g.

      bin/kafka-console-producer.sh --broker-list 192.168.50.10:9092,192.168.50.20:9092,192.168.50.30:9092 --topic sandbox

      bin/kafka-console-consumer.sh --zookeeper 192.168.50.5:2181 --topic sandbox --from-beginning

        Attachments

        1. KAFKA-1173-JMX.patch
          3 kB
          Stevo Slavic
        2. KAFKA-1173_2014-11-18_16:01:33.patch
          49 kB
          Ewen Cheslack-Postava
        3. KAFKA-1173_2014-11-12_11:32:09.patch
          47 kB
          Ewen Cheslack-Postava
        4. KAFKA-1173_2014-11-11_13:50:55.patch
          44 kB
          Ewen Cheslack-Postava
        5. KAFKA-1173.patch
          38 kB
          Ewen Cheslack-Postava
        6. KAFKA-1173_2013-12-07_12:07:55.patch
          7 kB
          Joe Stein

          Issue Links

            Activity

              People

              • Assignee:
                ewencp Ewen Cheslack-Postava
                Reporter:
                joestein Joe Stein
                Reviewer:
                Joe Stein
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: