Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-1993

Update storm-sql README to have actual dependencies

    XMLWordPrintableJSON

Details

    • Documentation
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.0.0, 1.0.1, 1.0.2, 1.0.3
    • storm-sql
    • None

    Description

      http://storm.apache.org/releases/1.0.1/storm-sql.html

      In order to run storm-sql-kafka example, the document states that users need to copy these jar files to extlib:

      curator-client-2.5.0.jar, curator-framework-2.5.0.jar, zookeeper-3.4.6.jar, scala-library-2.10.4.jar, kafka-clients-0.8.2.1.jar, kafka_2.10-0.8.2.1.jar, metrics-core-2.2.0.jar, json-simple-1.1.1.jar, jackson-annotations-2.6.0.jar,storm-kafka-*.jar storm-sql-kafka-*.jar,storm-sql-runtime-*.jar

      But in fact this is not enough to run the example from Storm 1.0.2 RC3.

      I need to copy below things to extlib to make workers running properly.

      calcite-avatica-1.4.0-incubating.jar
      calcite-core-1.4.0-incubating.jar
      calcite-linq4j-1.4.0-incubating.jar
      commons-lang-2.6.jar
      curator-client-2.5.0.jar
      curator-framework-2.5.0.jar
      guava-16.0.1.jar
      jackson-annotations-2.6.0.jar
      jackson-core-2.6.3.jar
      jackson-databind-2.6.3.jar
      json-simple-1.1.1.jar
      kafka-clients-0.8.2.1.jar
      kafka_2.10-0.8.2.1.jar
      metrics-core-2.2.0.jar
      scala-library-2.10.4.jar
      storm-kafka-1.0.2.jar
      storm-sql-kafka-1.0.2.jar
      storm-sql-runtime-1.0.2.jar
      zookeeper-3.4.6.jar
      

      While I feel storm-sql also needs to provide uber jar with shaded dependencies (since copying them to extlib affects worker classpath which breaks user topologies) guide document should be updated to run the example properly.

      Attachments

        Activity

          People

            kabhwan Jungtaek Lim
            kabhwan Jungtaek Lim
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 40m
                40m