Avro
  1. Avro
  2. AVRO-1061

Add sync interval option to Avro commandline tools

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Trivial Trivial
    • Resolution: Unresolved
    • Affects Version/s: 1.7.0
    • Fix Version/s: None
    • Component/s: java
    • Labels:
      None

      Description

      It would be nice to expose the sync interval to the avro commandline writer tools, since I've seen a 20%+ decrease in file size using deflate compression and a 64K+ sync interval instead of the default of 16K.

        Activity

        Hide
        Doug Cutting added a comment -

        This looks good to me.

        We should probably add a test to TestDataFileTools that checks this.

        Should we also increase the default sync interval to 64k?

        Show
        Doug Cutting added a comment - This looks good to me. We should probably add a test to TestDataFileTools that checks this. Should we also increase the default sync interval to 64k?

          People

          • Assignee:
            Unassigned
            Reporter:
            Ari Pollak
          • Votes:
            1 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:

              Development