[NUTCH-417] After upgrade to hadoop-0.9.1, parsing and indexing doesn't work.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 0.9.0
• Assignee: Andrzej Bialecki
• Reporter: Dogacan Guney
• Created: 15/Dec/06 13:26
• Updated: 09/May/07 18:43
• Resolved: 09/May/07 18:43

Description

If you parse while fetching then it is fine, but if you run parse as a different job, it creates an essentially empty parse_data directory(which has index files, but doesn't have data files). I am not sure why this is happening.

Also, indexing fails at Indexer.OutputFormat.getRecordWriter. The parameter fs seems to be an instance of PhasedFileSystem which throws exceptions on delete and

{start,complete}

LocalOutput.