Issue Details (XML | Word | Printable)

Key: HADOOP-3577
Type: Improvement Improvement
Status: Closed Closed
Resolution: Fixed
Priority: Minor Minor
Assignee: Sanjay Radia
Reporter: Sanjay Radia
Votes: 0
Watchers: 0
Operations

If you were logged in you would be able to see more operations.
Hadoop Common

Tools to inject blocks into name node and simulated data nodes for testing

Created: 17/Jun/08 04:47 AM   Updated: 08/Jul/09 04:43 PM
Return to search
Component/s: None
Affects Version/s: None
Fix Version/s: 0.19.0

Time Tracking:
Not Specified

File Attachments:
  Size
Text File Licensed for inclusion in ASF works inject.patch 2008-06-17 04:52 AM Sanjay Radia 23 kB
Text File Licensed for inclusion in ASF works inject2.patch 2008-06-18 10:47 PM Sanjay Radia 24 kB
Text File Licensed for inclusion in ASF works inject3.patch 2008-06-23 07:01 PM Lohit Vijayarenu 24 kB

Hadoop Flags: Reviewed
Resolution Date: 23/Jun/08 11:13 PM


 Description  « Hide
This jira adds the following 2 features to src/test
1) it extends DataNodeCluster to allow blocks to be injected for simulted data nodes.
2) a new command, CreatedEditsLog which creates an NN image edits logs that has a transactions for new files. The edits log file can be copied to the NN's image.

Using the two in conjunction one can inject a set of blocks in a NN and in a set of Datanodes and use it for testing, for example a cluster of 3K DNs



 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Repository Revision Date User Message
ASF #670787 Mon Jun 23 23:12:54 UTC 2008 hairong HADOOP-3577. Tools to inject blocks into name node and simulated data nodes for testing. Contributed by Sanjay Radia.
Files Changed
MODIFY /hadoop/core/trunk/src/hdfs/org/apache/hadoop/dfs/FSEditLog.java
MODIFY /hadoop/core/trunk/src/test/org/apache/hadoop/dfs/SimulatedFSDataset.java
MODIFY /hadoop/core/trunk/src/hdfs/org/apache/hadoop/dfs/Storage.java
MODIFY /hadoop/core/trunk/CHANGES.txt
MODIFY /hadoop/core/trunk/src/test/org/apache/hadoop/dfs/DataNodeCluster.java
MODIFY /hadoop/core/trunk/src/hdfs/org/apache/hadoop/dfs/DataNode.java
MODIFY /hadoop/core/trunk/src/test/org/apache/hadoop/dfs/MiniDFSCluster.java
MODIFY /hadoop/core/trunk/src/test/org/apache/hadoop/dfs/TestSimulatedFSDataset.java

Repository Revision Date User Message
ASF #671277 Tue Jun 24 17:54:38 UTC 2008 hairong add the missed org.apache.hadoop.dfs.CreateEditsLog.java to trunk as part of HADOOP-3577.
Files Changed
ADD /hadoop/core/trunk/src/test/org/apache/hadoop/dfs/CreateEditsLog.java