Avro
  1. Avro
  2. AVRO-828

The 16-byte, sync marker for file not generated till first record written.

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Invalid
    • Affects Version/s: 1.5.1
    • Fix Version/s: None
    • Component/s: java
    • Environment:

      Java 1.6

      Description

      When opening an avro file to be written, the 16-byte, sync marker for file not generated till first record written or the file properly closed. Our usecase has the logs being rotated if they have no open filehandles which means if we open a file and experience an unclean shutdown we get files that throw exceptions on processing. When records are written the sync marker is written on each write which prevents this from being a problem on non-empty files. Can we write the sync marker when the header is written instead of on first record write?

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Unassigned
            Reporter:
            Douglas Britsch
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development