Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1381

The distance between sync blocks in SequenceFiles should be configurable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 3.0.0-alpha2
    • Component/s: io
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      The default sync interval within new SequenceFile writes is now 100KB, up from the older default of 2000B. The sync interval is now also manually configurable via the SequenceFile.Writer API.

      Description

      Currently SequenceFiles put in sync blocks every 2000 bytes. It would be much better if it was configurable with a much higher default (1mb or so?).

        Attachments

        1. HADOOP-1381.r5.diff
          9 kB
          Harsh J
        2. HADOOP-1381.r5.diff
          9 kB
          Harsh J
        3. HADOOP-1381.r4.diff
          9 kB
          Harsh J
        4. HADOOP-1381.r3.diff
          9 kB
          Harsh J
        5. HADOOP-1381.r2.diff
          8 kB
          Harsh J
        6. HADOOP-1381.r1.diff
          6 kB
          Harsh J

          Issue Links

            Activity

              People

              • Assignee:
                qwertymaniac Harsh J
                Reporter:
                owen.omalley Owen O'Malley
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: