Uploaded image for project: 'Eagle (Retired)'
  1. Eagle (Retired)
  2. EAGLE-593

Eagle Topology assembly multi-version Hadoop support & bug fix

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • v0.5.0
    • v0.5.0
    • None

    Description

      1. User may want to support different version of hadoop in eagle jpm when uses topology asembly to be a final package. For this requirement, we add profiles to eagle-topology-assembly pom.xml. In this pom, we could add different versions of Hadoop.
      2. Fix StormSubmitter does not support submit another jar
      In storm StormSubmitter
      ----------------------------------------------------------------------------------------------
      private static String submittedJar = null;
      private static void submitJar(Map conf, ProgressListener listener) {
      if(submittedJar==null)

      { LOG.info("Jar not uploaded to master yet. Submitting jar..."); String localJar = System.getProperty("storm.jar"); submittedJar = submitJar(conf, localJar, listener); }

      else

      { LOG.info("Jar already uploaded to master. Not submitting jar."); }

      }
      ----------------------------------------------------------------------------------------------
      It can not submit another jar once submittedJar is set.
      So I rewrote this class.
      3. Fix MR Running Job that does not set finished jobs' state

      Attachments

        Issue Links

          Activity

            People

              wujinhu wujinhu
              wujinhu wujinhu
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: