Uploaded image for project: 'Commons IO'
  1. Commons IO
  2. IO-382

Chunked IO for large arrays

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.5
    • Utilities
    • None

    Description

      File IO involves native code at some point.
      It seems that native code which accesses a Java
      array may involve copying the array (depending on the JVM) [1]

      This can easily lead to an OutOfMemory condition if the array is large.

      It would be useful to provide some utility methods to process the array in chunks of (say) 4K. It's unlikely that applications will use huge read buffers, but they may well need to write large buffers, so only output chunking is likely to be useful.

      It might also be useful to create a ChunkedOutputStream/Writer which provides the chunking automatically.

      [1] http://docs.oracle.com/javase/7/docs/technotes/guides/jni/spec/design.html#wp1265

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              sebb Sebb
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: