Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-561

one replica of a file should be written locally if possible

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.8.0
    • None
    • None

    Description

      one replica of a file should be written locally if possible. That's currently not the case.
      Copying a 1GB file using hadoop dfs -cp running on one of the cluster nodes, all the blocks were written to remote nodes, as seen by fsck -files -blocks -locations on the newly created file.

      as long as there is sufficient space locally, a local copy has significant performance benefits.

      Attachments

        1. localreplica.patch
          3 kB
          Dhruba Borthakur

        Activity

          People

            dhruba Dhruba Borthakur
            yarnon Yoram Arnon
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: