Issue Details (XML | Word | Printable)

Key: HADOOP-3413
Type: Bug Bug
Status: Closed Closed
Resolution: Fixed
Priority: Critical Critical
Assignee: Tom White
Reporter: Arun C Murthy
Votes: 0
Watchers: 2
Operations

If you were logged in you would be able to see more operations.
Hadoop Common

SequenceFile.Reader doesn't use the Serialization framework

Created: 19/May/08 08:33 AM   Updated: 22/Aug/08 07:50 PM
Return to search
Component/s: io
Affects Version/s: 0.17.0
Fix Version/s: 0.18.0

Time Tracking:
Not Specified

File Attachments:
  Size
Text File Licensed for inclusion in ASF works hadoop-3413-v2.patch 2008-06-02 04:39 PM Tom White 18 kB
Text File Licensed for inclusion in ASF works hadoop-3413-v3.patch 2008-06-02 07:55 PM Tom White 19 kB
Text File Licensed for inclusion in ASF works hadoop-3413-v4.patch 2008-06-06 10:53 AM Tom White 21 kB
Text File Licensed for inclusion in ASF works hadoop-3413.patch 2008-05-19 01:53 PM Tom White 9 kB

Hadoop Flags: Reviewed
Resolution Date: 06/Jun/08 10:24 PM


 Description  « Hide
Currently SequenceFile.Reader only works with Writables, since it doesn't use the new Serialization framework. This is a glaring considering that SequenceFile.Writer uses the Serializer and handles arbitrary types via the SerializationFactory.

 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Repository Revision Date User Message
ASF #664159 Fri Jun 06 22:18:48 UTC 2008 omalley HADOOP-3413. Allow SequenceFile.Reader to use serialization framework. Contributed by Tom White.
Files Changed
MODIFY /hadoop/core/trunk/src/java/org/apache/hadoop/mapred/SequenceFileInputFormat.java
MODIFY /hadoop/core/trunk/src/java/org/apache/hadoop/io/SequenceFile.java
MODIFY /hadoop/core/trunk/CHANGES.txt
MODIFY /hadoop/core/trunk/src/java/org/apache/hadoop/mapred/SequenceFileOutputFormat.java
MODIFY /hadoop/core/trunk/src/java/org/apache/hadoop/mapred/lib/MultithreadedMapRunner.java
MODIFY /hadoop/core/trunk/src/java/org/apache/hadoop/mapred/lib/MultipleOutputFormat.java
MODIFY /hadoop/core/trunk/src/java/org/apache/hadoop/mapred/SequenceFileRecordReader.java
MODIFY /hadoop/core/trunk/src/java/org/apache/hadoop/mapred/lib/MultipleTextOutputFormat.java
MODIFY /hadoop/core/trunk/src/java/org/apache/hadoop/mapred/lib/MultipleSequenceFileOutputFormat.java
MODIFY /hadoop/core/trunk/src/java/org/apache/hadoop/mapred/SequenceFileInputFilter.java

Repository Revision Date User Message
ASF #665778 Mon Jun 09 17:07:37 UTC 2008 omalley HADOOP-3413. I missed the test file.
Files Changed
ADD /hadoop/core/trunk/src/test/org/apache/hadoop/io/TestSequenceFileSerialization.java

Repository Revision Date User Message
ASF #665791 Mon Jun 09 17:24:17 UTC 2008 omalley Adding missed test file for HADOOP-3413.
Files Changed
ADD /hadoop/core/branches/branch-0.18/src/test/org/apache/hadoop/io/TestSequenceFileSerialization.java (from /hadoop/core/trunk/src/test/org/apache/hadoop/io/TestSequenceFileSerialization.java)