Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6584 Support Archival Storage
  3. HDFS-6997

Archival Storage: add more tests for data migration and replicaion

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      This JIRA also includes a fix for free space calculation in BlockPlacementPolicyDefault. Previously, when calculating the amount of free space per storage, it was using the per-node rather than the per-storage number of blocks currently scheduled for write. This grossly overestimates the amount of space to reserve for open files, and can result in storages being incorrectly marked as full.
      Show
      This JIRA also includes a fix for free space calculation in BlockPlacementPolicyDefault. Previously, when calculating the amount of free space per storage, it was using the per-node rather than the per-storage number of blocks currently scheduled for write. This grossly overestimates the amount of space to reserve for open files, and can result in storages being incorrectly marked as full.

      Description

      This JIRA is to add more tests to check if the data migration tool could move the replicas correctly and if the replication monitor could replicate block correctly when storage policy is considered.

        Attachments

        1. h6997_20140907.patch
          41 kB
          Tsz Wo Nicholas Sze
        2. h6997_20140905b.patch
          33 kB
          Tsz Wo Nicholas Sze
        3. h6997_20140905.patch
          33 kB
          Tsz Wo Nicholas Sze

          Activity

            People

            • Assignee:
              szetszwo Tsz Wo Nicholas Sze
              Reporter:
              szetszwo Tsz Wo Nicholas Sze
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: