Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6584 Support Archival Storage
  3. HDFS-6997

Archival Storage: add more tests for data migration and replicaion

    XMLWordPrintableJSON

Details

    • Reviewed
    • Hide
      This JIRA also includes a fix for free space calculation in BlockPlacementPolicyDefault. Previously, when calculating the amount of free space per storage, it was using the per-node rather than the per-storage number of blocks currently scheduled for write. This grossly overestimates the amount of space to reserve for open files, and can result in storages being incorrectly marked as full.
      Show
      This JIRA also includes a fix for free space calculation in BlockPlacementPolicyDefault. Previously, when calculating the amount of free space per storage, it was using the per-node rather than the per-storage number of blocks currently scheduled for write. This grossly overestimates the amount of space to reserve for open files, and can result in storages being incorrectly marked as full.

    Description

      This JIRA is to add more tests to check if the data migration tool could move the replicas correctly and if the replication monitor could replicate block correctly when storage policy is considered.

      Attachments

        1. h6997_20140905.patch
          33 kB
          Tsz-wo Sze
        2. h6997_20140905b.patch
          33 kB
          Tsz-wo Sze
        3. h6997_20140907.patch
          41 kB
          Tsz-wo Sze

        Activity

          People

            szetszwo Tsz-wo Sze
            szetszwo Tsz-wo Sze
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: