Uploaded image for project: 'Tika'
  1. Tika
  2. TIKA-490

Support for adding language profiles dynamically

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.7
    • 0.8
    • languageidentifier
    • None

    Description

      Currently the Tika LanguageIdentifier loads language profiles thorugh a hardcoded static block in the java code.

      It would be better to make this configurable, so you could add your own languages without recompiling.

      Suggested approach:
      Remove the static code block loading all languages. Instead look for a tika.languageidentification.properties file on classpath.
      Now the user can simply make his/her own (additional) language profile files, put them on the classpath together with a properties file and off you go!

      Also, once you make it configurable, there might be an issue of having the profiles as static members, as you will force the same behaviour for the whole VM. A static Map of Maps could solve this.

      Attachments

        1. TIKA-490.patch
          8 kB
          Jan Høydahl
        2. TIKA-490.patch
          8 kB
          Jan Høydahl
        3. TIKA-490.Mattmann.082210.patch.txt
          10 kB
          Chris A. Mattmann
        4. TIKA-490.Mattmann.082210.2.patch.txt
          11 kB
          Chris A. Mattmann
        5. TIKA-490.janhoy.092010.patch
          14 kB
          Jan Høydahl
        6. TIKA-490.janhoy.092010.patch
          14 kB
          Jan Høydahl
        7. TIKA-490.janhoy.082310.patch
          12 kB
          Jan Høydahl
        8. TIKA-490.janhoy.082310.patch
          12 kB
          Jan Høydahl

        Activity

          People

            chrismattmann Chris A. Mattmann
            janhoy Jan Høydahl
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified