Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-378

too many files are distributed to slaves nodes

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Trivial
    • Resolution: Incomplete
    • None
    • None
    • conf
    • None

    Description

      currently all the svn tree is sync'ed to the slaves on startup, excluding only .svn files.
      that includes the example jar file, sources, and other files that are not required.
      It would be better to pick and choose the files that get sync'ed. It will improve sync times on startup, and can prevent some name conflicts, since all the jar files are also included in the classpath by the hadoop script.

      Attachments

        Activity

          People

            Unassigned Unassigned
            yarnon Yoram Arnon
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: