Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1381

The distance between sync blocks in SequenceFiles should be configurable

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.0.0-alpha
    • 3.0.0-alpha2
    • io
    • None
    • Reviewed
    • The default sync interval within new SequenceFile writes is now 100KB, up from the older default of 2000B. The sync interval is now also manually configurable via the SequenceFile.Writer API.

    Description

      Currently SequenceFiles put in sync blocks every 2000 bytes. It would be much better if it was configurable with a much higher default (1mb or so?).

      Attachments

        1. HADOOP-1381.r5.diff
          9 kB
          Harsh J
        2. HADOOP-1381.r5.diff
          9 kB
          Harsh J
        3. HADOOP-1381.r4.diff
          9 kB
          Harsh J
        4. HADOOP-1381.r3.diff
          9 kB
          Harsh J
        5. HADOOP-1381.r2.diff
          8 kB
          Harsh J
        6. HADOOP-1381.r1.diff
          6 kB
          Harsh J

        Issue Links

          Activity

            People

              qwertymaniac Harsh J
              omalley Owen O'Malley
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: