Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9282

Make data directory count and storage raw capacity related tests FsDataset-agnostic

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.7.1
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: test
    • Labels:
      None
    • Target Version/s:

      Description

      DFSMiniCluster and several tests have hard coded assumption of the underlying storage having 2 data directories (volumes). As HDFS-9188 pointed out, with new FsDataset implementations, these hard coded assumption about number of data directories and raw capacities of storage may change as well.

      We need to extend FsDatasetTestUtils to provide:

      • Number of data directories of underlying storage per DataNode
      • Raw storage capacity of underlying storage per DataNode.
      • Have MiniDFSCluster automatically pick up the correct values.

        Attachments

        1. HDFS-9282.004.patch
          9 kB
          Tony Wu
        2. HDFS-9282.003.patch
          9 kB
          Tony Wu
        3. HDFS-9282.002.patch
          9 kB
          Tony Wu
        4. HDFS-9282.001.patch
          8 kB
          Tony Wu

          Issue Links

            Activity

              People

              • Assignee:
                twu Tony Wu
                Reporter:
                twu Tony Wu
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: