Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-1387

DataFileWriter must allow files not to be flushed at the end of every block.

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.7.6
    • Component/s: None
    • Labels:
      None

      Description

      We are considering changes in Flume's file channel to use Avro, one of the requirements is that each event (which maps to one avro record) be checksummed so we know if the data is corrupt.

      We'd probably have to add a new version for this, since this will change the data format on disk. I can start working on a Java version if there are no objections

        Attachments

        1. AVRO-1387.patch
          8 kB
          Hari Shreedharan

        Issue Links

          Activity

            People

            • Assignee:
              hshreedharan Hari Shreedharan
              Reporter:
              hshreedharan Hari Shreedharan

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment