[TIKA-3288] Allow batching for emitters

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: tika-pipes
• Assignee: Unassigned
• Reporter: Tim Allison
• Created: 29/Jan/21 22:00
• Updated: 03/Feb/21 18:56

Description

Started an interface in comments: https://github.com/apache/tika/blob/main/tika-core/src/main/java/org/apache/tika/pipes/emitter/Emitter.java#L34

 

The AbstractEmitter can keep track of "batch size" – how many bytes are in the batch.  The caller can check for that after each addition and then call executeBatch, or at the end of the task list.

 

We'll have to have a separate handler in tika-server `async-emit` ( ? ) to handle this.