Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-1764

Fix copying mapreduce jars to HDFS for Oozie

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.0.0
    • 1.0.0
    • deployment
    • None

    Description

      On HDFS after puppet apply, /user/oozie/share/lib/distcp does not exist and /user/oozie/share/lib/mapreduce-streaming is empty. This looks to be a bug in copying jars in init-hcfs.groovy#L283

      $ hadoop fs -ls /user/oozie/share/lib/
      drwxr-xr-x   - hdfs hadoop          0 2015-03-18 21:47 /user/oozie/share/lib/distcp
      drwxr-xr-x   - hdfs hadoop          0 2015-03-18 21:47 /user/oozie/share/lib/hive
      drwxr-xr-x   - hdfs hadoop          0 2015-03-18 21:47 /user/oozie/share/lib/mapreduce
      drwxr-xr-x   - hdfs hadoop          0 2015-03-18 21:47 /user/oozie/share/lib/mapreduce-streaming
      drwxr-xr-x   - hdfs hadoop          0 2015-03-18 21:47 /user/oozie/share/lib/pig
      
      $ hadoop fs -ls /user/oozie/share/lib/mapreduce-streaming
      

      Attachments

        1. BIGTOP-1764.1.patch
          1 kB
          Peter Slawski

        Activity

          People

            petersla Peter Slawski
            petersla Peter Slawski
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: