Issue Details (XML | Word | Printable)

Key: HDFS-243
Type: New Feature New Feature
Status: Open Open
Priority: Major Major
Assignee: Unassigned
Reporter: Meng Xu
Votes: 0
Watchers: 6
Operations

If you were logged in you would be able to see more operations.
Hadoop HDFS

Namenode cluster(multi namenode working in active-active mode) to keep high availability and expansivity

Created: 19/Jun/08 07:54 AM   Updated: 07/Jul/09 11:22 PM
Return to search
Component/s: None
Affects Version/s: None
Fix Version/s: None

Time Tracking:
Original Estimate: 672h
Original Estimate - 672h
Remaining Estimate: 672h
Remaining Estimate - 672h
Time Spent: Not Specified
Remaining Estimate - 672h

Environment: Hadoop cluster on more than thousands of nodes, most of all, the number of files is mass.
Issue Links:
Reference
 


 Description  « Hide
If we use the DFS to store a great quantity of files which is very small, i.e. the namenode is under high pressure of indexing files, should we consider to introduce other namenodes working concurrently for availability and scalability?

 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Qi Ji added a comment - 09/Jul/08 07:10 AM
Yeah, when the file number approximates 100 million the overall performance is greatly affected by name node performance. We are going to work this out by a patch about cooperative multi namenodes soon.