Bigtop
  1. Bigtop
  2. BIGTOP-474

improve Oozie integration with Hadoop 0.23

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.4.0
    • Fix Version/s: 0.4.0
    • Component/s: general
    • Labels:
      None

      Description

      Here's a bunch of improvements to the way Oozie is packaged in Bigtop that I would like to suggest based on my conversations so far:

      1. renaming /usr/lib/oozie/oozie-core -> /usr/lib/oozie/libserver (that will give us lib, libtools and libserver and is pretty consistent)
      2. add /var/lib/oozie to the catalina.properties classpath so that users can simply drop jar files there (e.g. for jdbc connectors)
      3. add /etc/hadoop/conf to the oozie-site.xml oozie.service.HadoopAccessorService.hadoop.configurations
      4. get rid of /etc/oozie/conf/hadoop-conf (once #3 is done)
      5. make sure we don't ship docs twice (once in /usr/share/docs/oozie and the other time in webapps)

      I'll attach a patch shortly. But in the meantime, please let me know what do you think.

      1. BIGTOP-474.patch.txt
        4 kB
        Roman Shaposhnik

        Activity

        Roman Shaposhnik created issue -
        Roman Shaposhnik made changes -
        Field Original Value New Value
        Description Here's a bunch of improvements to the way Oozie is packaged in Bigtop that I would like to suggest based on my conversations so far:
          # renaming /usr/lib/oozie/oozie-server -> /usr/lib/oozie/libserver (that will give us lib, libtools and libserver and is pretty consistent)
          # add /var/lib/oozie to the catalina.properties classpath so that users can simply drop jar files there (e.g. for jdbc connectors)
          # add /etc/hadoop/conf to the oozie-site.xml oozie.service.HadoopAccessorService.hadoop.configurations
          # get rid of /etc/oozie/conf/hadoop-conf (once #3 is done)
          # make sure we don't ship docs twice (once in /usr/share/docs/oozie and the other time in webapps)

        I'll attach a patch shortly. But in the meantime, please let me know what do you think.
        Here's a bunch of improvements to the way Oozie is packaged in Bigtop that I would like to suggest based on my conversations so far:
          # renaming /usr/lib/oozie/oozie-core -> /usr/lib/oozie/libserver (that will give us lib, libtools and libserver and is pretty consistent)
          # add /var/lib/oozie to the catalina.properties classpath so that users can simply drop jar files there (e.g. for jdbc connectors)
          # add /etc/hadoop/conf to the oozie-site.xml oozie.service.HadoopAccessorService.hadoop.configurations
          # get rid of /etc/oozie/conf/hadoop-conf (once #3 is done)
          # make sure we don't ship docs twice (once in /usr/share/docs/oozie and the other time in webapps)

        I'll attach a patch shortly. But in the meantime, please let me know what do you think.
        Roman Shaposhnik made changes -
        Attachment BIGTOP-474.patch.txt [ 12519257 ]
        Roman Shaposhnik made changes -
        Attachment BIGTOP-474.patch.txt [ 12519257 ]
        Roman Shaposhnik made changes -
        Attachment BIGTOP-474.patch.txt [ 12519258 ]
        Roman Shaposhnik made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Gavin made changes -
        Workflow no-reopen-closed, patch-avail [ 12658822 ] patch-available, re-open possible [ 12665673 ]
        Roman Shaposhnik made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Roman Shaposhnik
            Reporter:
            Roman Shaposhnik
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development