Issue Details (XML | Word | Printable)

Key: MAPREDUCE-458
Type: New Feature New Feature
Status: Open Open
Priority: Minor Minor
Assignee: Owen O'Malley
Reporter: Mahadev konar
Votes: 0
Watchers: 3
Operations

If you were logged in you would be able to see more operations.
Hadoop Map/Reduce

Adding caching to Hadoop which is independent of the task trackers.

Created: 12/Aug/06 12:01 AM   Updated: 20/Jun/09 07:57 AM
Return to search
Component/s: None
Affects Version/s: None
Fix Version/s: None

Time Tracking:
Not Specified

Issue Links:
Reference
 


 Description  « Hide
It would be nice to have a feature in Hadoop that could cache files locally that is independent of TaskTrackers and JobTrackers. Hadoop-288 caching is dependent on the tasktrackers. In an environment where you would dynamically bring up and down the TaskTrackers for resource sharing, that is problematic. It would be good to have this feature wherein you can install tasktrackers/jobtrackers on these machines using this caching mechanism. The caching feature could use something like Bittorent /http/rsync to copy the main hadoop.jar.

 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
There are no subversion log entries for this issue yet.