[TIKA-3329] RTG Translator with many-to-eng translation

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: translation
• Labels: memex
• Assignee: Chris Mattmann
• Reporter: Thamme Gowda
• Created: 17/Mar/21 18:53
• Updated: 02/May/21 16:30
• Resolved: 01/May/21 20:54

Description

The existing translation services in tika-translate are either commercial/paid engines (e.g. Google, Microsoft  etc ) or not state of the art (such as Joshua, Moses etc).

Reader Translator Generator () is a neural machine translation toolkit https://isi-nlp.github.io/rtg/
 and has the implementation of Transformer NMT model (current state of the art).
It also has massively multilingual pretrained NMT model  ( many-to-English translation direction)  https://hub.docker.com/repository/docker/tgowda/rtg-model
in which about 500 source languages are represented, with atleast ~300 source languages have good enough quality (For a comparison Google translate has ~106 languages, and Microsoft has about 80 languages). 

This issue is for integrating RTG Translator into tika-translate