Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-1387

DataFileWriter must allow files not to be flushed at the end of every block.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.7.6
    • Component/s: None
    • Labels:
      None

      Description

      We are considering changes in Flume's file channel to use Avro, one of the requirements is that each event (which maps to one avro record) be checksummed so we know if the data is corrupt.

      We'd probably have to add a new version for this, since this will change the data format on disk. I can start working on a Java version if there are no objections

        Attachments

        1. AVRO-1387.patch
          8 kB
          Hari Shreedharan

          Issue Links

            Activity

              People

              • Assignee:
                hshreedharan Hari Shreedharan
                Reporter:
                hshreedharan Hari Shreedharan
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: