[TIKA-4181] Tika Grpc Server using Tika Pipes

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: tika-pipes
• Assignee: Unassigned
• Reporter: Nicholas DiPiazza
• Created: 11/Jan/24 14:21
• Updated: 22/Sep/24 20:01

Description

Create a Tika Grpc server.

You should be able to create Tike Pipes fetchers, then use those fetchers. 

You can then use those fetchers to FetchAndParse in 3 ways:

• synchronous fashion - you send a single request to fetch a file, and get a single FetchAndParse response tuple.
• streaming output - you send a single request and stream back the FetchAndParse response tuple.
• bi-directional streaming - You stream in 1 or more Fetch requests and stream back FetchAndParse response tuples.

Requires we create a service contract that specifies the inputs we require from each method.

Then we will need to implement the different components with a grpc client generated using the contract.

This would enable developers to run tika-pipes as a persistently running daemon instead of just a single batch app, because it can continue to stream out more inputs.

Issue Links

• is depended upon by: TIKA-4271 Support TCP liveness probe in Tika Helm chart
• links to: GitHub Pull Request #1702
• links to: GitHub Pull Request #1832