Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7632

MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.7.0
    • test
    • None
    • Reviewed

    Description

      MiniDFSCluster allows the caller to set the number of storage locations per DataNode. If this number is set higher than 2, and if the cluster is configured with more than 1 DataNode, then the calculation of the storage directory paths will be incorrect. Multiple DataNodes will attempt to use the same storage directory, and one of them will fail while trying to acquire the file lock.

      Attachments

        1. HDFS-7632.001.patch
          27 kB
          Chris Nauroth

        Issue Links

          Activity

            People

              cnauroth Chris Nauroth
              cnauroth Chris Nauroth
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: