[HADOOP-226] DFSShell problems. Incorrect block replication detection in fsck.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 0.5.0

Environment

All

• Assignee: Unassigned
• Reporter: Konstantin Shvachko
• Created: 18/May/06 05:10
• Updated: 08/Jul/09 16:41
• Resolved: 04/Aug/06 19:36

Description

1. We need to adjust Dfsck to the new per-file replication feature.
fsck checks block replication based on the configured global replication parameter.
Which is now just the default. The actual file replication is returned in DFSFileInfo.
So at least the reporting is screwed by that, although I didn't check what will happen with
other options -move and -delete.

2. fsck throws NullPointerException if you type
bin/hadoop fsck -files /doc
instead of
bin/hadoop fsck /doc -files

3. Unfortunately, there are several commands that throw different kinds of Exceptions
rather than at least printing the usage info, when some of its arguments are missing or
misplaced. ArrayIndexOutOfBoundsException is one them. Try
bin/hadoop dfs -mv
bin/hadoop dfs -cp
bin/hadoop dfs -rm

4. In general the shell is growing and getting more sophisticated.
Should we work out a general convention on how the parameters should be structured, named,
short/long version of the keywords, help, etc.