1. FOP
  2. FOP-2189

Apache FOP 1.0 Multithreading Problems - Too many open files err24



      We use Apache FOP to convert a whole lot of XML's to AFP's and PDF's. Our current load would be around 25k files per run on a HP-UX system. We have 12 threads in total that are used to initialize and trigger the FOP conversion in a producer-consumer fashion. Recently there have been multiple failures during conversion and when looked up, we've received generic FOP errors like:

      *ERROR,2460364,FOToPDF_Thread_11,FOP Exception, something.pdf,Failed to resolve font with embed-url './Fonts/arial.ttf'*

      or its an error failing to load the font metrics file although the files are intact with the right permissions. Many other PDF's are generated so this can't be the problem.

      We also wind up with:
      * /PDF/20130111130002/something.pdf (Too many open files (errno:24))*

      judging by the logs and volume being processed, this looks like an FOP problem. I've read that FOP has had this issue in the past with the font files. There have been instances where Apache has opened each font file multiple times and not closed the handles resulting in a large number of open files. This was supposed to be fixed, but if it still persists, what would be a good and quick solution to this?

      1. Analyzer.log
        1 kB
        Joey Ezekiel
      2. tusc.log
        40 kB
        Joey Ezekiel


        Joey Ezekiel made changes -
        Comment [ tusc.log contains the open/close commands monitored on the unix bos. Analyzer.log gives which files are being left open. The jar files/system commands can be ignored - the calls to the image files are the concern. ]
        Joey Ezekiel made changes -
        Attachment tusc.log [ 12586735 ]
        Attachment Analyzer.log [ 12586736 ]
        Joey Ezekiel made changes -
        Priority P2 [ 10595 ] P1 [ 10587 ]
        Joey Ezekiel made changes -
        Severity major [ 10591 ] blocker [ 10592 ]
        Joey Ezekiel made changes -
        Resolution Fixed [ 1 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        Chris Bowditch made changes -
        Field Original Value New Value
        Status Open [ 1 ] Resolved [ 5 ]
        Fix Version/s trunk [ 12323672 ]
        Resolution Fixed [ 1 ]
        Joey Ezekiel created issue -


          • Assignee:
            Joey Ezekiel
          • Votes:
            0 Vote for this issue
            5 Start watching this issue


            • Created: