Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7713

Add parallel copying of directories into FSDownload

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      YARN currently copies directories sequentially when localizing. This could be improved to do in parallel, since the source blocks are normally on different nodes.

      Attachments

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. YARN-2185 Use pipes when localizing archives

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #2614

          Activity

            People

              ChrisKarampeazis Christos Karampeazis-Papadakis
              miklos.szegedi@cloudera.com Miklos Szegedi
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h
                  1h