Commons Compress
  1. Commons Compress
  2. COMPRESS-48

[compress] add a memory efficient stream compress InputStream - e.g. a "DeflaterInputStream"

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Environment:

      Operating System: All
      Platform: Other

      Description

      Assume from a struts-tomcate web-app I get a large file that I want to store in
      a DB. To save DB permanent storage, I want to compress this. To be portable, I
      rather want to do that in java than on the DB-side with some proprietary commands.

      In order not to have to load into the RAM at least the entire compressed output
      by e.g. creating a ByteArrayOutputStream with for example
      java.util.zip.GZIPOutputStream or java.util.zip.DeflaterOutputStream and then
      converting it back to an InputStream for the PreparedStatement
      stmt.setBinaryStream(int pos,
      InputStream stream, int length), I envision an InputStream converter that is
      memory efficient.

      I started implementing it myself and got it working at least for
      single-byte reads. But it is far from production-readiness - perhaps I should
      rather extend java.io.PipedInputStream than trying to do my own efficient
      buffer management and do all the synchronize() blocking etc.
      ==> shouldn't something go into org.apache.commons.compress.zip?

      There are certainly other applications for such a class.

      P.S.: Alternatively, there is a "OutputStream java.sql.Blob.setBinaryStream(long
      pos)" but for example in MySQL that "updatable BLOB that can update in-place" is
      not yet implemented. Doing proprietary SQL-"COMPRESS" as per
      http://dev.mysql.com/doc/mysql/en/string-functions.html is probably an even less
      preferrable option.

        Activity

        Hide
        Ralf Hauser added a comment -

        see also COM-2359 and COM-2360

        Show
        Ralf Hauser added a comment - see also COM-2359 and COM-2360
        Hide
        Ralf Hauser added a comment -
        Show
        Ralf Hauser added a comment - see also http://lists.mysql.com/java/8369
        Hide
        Torsten Curdt added a comment -

        Should be exactly was trunk provides.

        Show
        Torsten Curdt added a comment - Should be exactly was trunk provides.

          People

          • Assignee:
            Torsten Curdt
            Reporter:
            Ralf Hauser
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development