[JENA-203] support for Non Blocking Parsers

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Assignee: Unassigned
• Reporter: Henry Story
• Created: 29/Jan/12 16:39
• Updated: 13/Jul/12 12:57
• Resolved: 13/Jul/12 12:57

Description

In a Linked Data environment servers have to fetch data off the web. The speed at which such data
is served can be very slow. So one wants to avoid using up one thread for each connections (1 thread =
0.5 to 1MB approximately). This is why Java NIO was developed and why servers such as Netty
are so popular, why http client libraries such as https://github.com/sonatype/async-http-client are more
and more numerous, and why framewks such as http://akka.io/ which support relatively lightweight
actors (500 bytes per actor) are growing more viisible.

Unless I am mistaken the only way to parse some content is using methods that use an
InputStream such as this:

val m = ModelFactory.createDefaultModel()
m.getReader(lang.jenaLang).read(m, in, base.toString)

That read call blocks. Would it be possible to have an API which allows
one to parse a document in chunks as they arrive from the input?