[AVRO-1387] DataFileWriter must allow files not to be flushed at the end of every block. - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 1.7.6
Component/s: None
Labels:
None

Description

We are considering changes in Flume's file channel to use Avro, one of the requirements is that each event (which maps to one avro record) be checksummed so we know if the data is corrupt.

We'd probably have to add a new version for this, since this will change the data format on disk. I can start working on a Java version if there are no objections

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

AVRO-1387.patch
20/Oct/13 20:13
8 kB
Hari Shreedharan

Issue Links

blocks

FLUME-1946 Tolerate disk failure in FileChannel

Open

Activity

People

Assignee:: Hari Shreedharan

Reporter:: Hari Shreedharan

Votes:: 0 Vote for this issue

Watchers:: 6 Start watching this issue

Dates

Created:: 17/Oct/13 19:33

Updated:: 23/Jan/14 21:58

Resolved:: 25/Oct/13 22:14