Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1151

Ability to configure auxiliary services from HDFS-based JAR files

    Details

    • Hadoop Flags:
      Reviewed

      Description

      I would like to install an auxiliary service in Hadoop YARN without actually installing files/services on every node in the system. Discussions on the user@ list indicate that this is not easily done. The reason we want an auxiliary service is that our application has some persistent-data components that are not appropriate for HDFS. In fact, they are somewhat analogous to the mapper output of MapReduce's shuffle, which is what led me to auxiliary-services in the first place. It would be much easier if we could just place our service's JARs in HDFS.

        Attachments

        1. YARN-1151.1.patch
          14 kB
          Xuan Gong
        2. [YARN-1151] [Design] Configure auxiliary services from HDFS-based JAR files.pdf
          45 kB
          Xuan Gong
        3. YARN-1151.branch-2.poc.patch
          19 kB
          Xuan Gong
        4. YARN-1151.branch-2.poc.2.patch
          14 kB
          Xuan Gong
        5. YARN-1151.branch-2.poc.3.patch
          19 kB
          Xuan Gong
        6. YARN-1151.2.patch
          19 kB
          Xuan Gong
        7. YARN-1151.3.patch
          20 kB
          Xuan Gong
        8. YARN-1151.4.patch
          26 kB
          Xuan Gong
        9. YARN-1151.5.patch
          26 kB
          Xuan Gong
        10. YARN-1151.6.patch
          26 kB
          Xuan Gong

          Issue Links

            Activity

              People

              • Assignee:
                xgong Xuan Gong
                Reporter:
                john.lilley@redpoint.net john lilley
              • Votes:
                0 Vote for this issue
                Watchers:
                20 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: