Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7240 Scaling HDFS
  3. HDFS-13302

Ozone: fix classpath of yarn components

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HDFS-7240
    • HDFS-7240
    • HDFS-7240
    • None
    • Reviewed

    Description

      HDFS-13258 introduced a separated classpath for hdsl/cblock/ozone components.

      The reason is the behaviour of the dist-layout-stitching. The internal copy command in the dist-layout-stitching copies the jar files only if they don not exist in any of the existing subfolder of the share/hadoop directory.

      With the new separated classpath if some of the dependencies are already copied to share/hadoop/hdsl or share/hadoop/ozone, they won't be copied to the share/hadoop/yarn directory and won't be added to the classpath. (as the hdsl copy is before the yarn copy commands)

      Could be fixed easily with moving the ozone/cblock/hdsl related stuff to the end of the dist-layout-stitching.

      Attachments

        Activity

          People

            elek Marton Elek
            elek Marton Elek
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: