Uploaded image for project: 'Tika'
  1. Tika
  2. TIKA-490

Support for adding language profiles dynamically

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.7
    • Fix Version/s: 0.8
    • Component/s: languageidentifier
    • Labels:
      None

      Description

      Currently the Tika LanguageIdentifier loads language profiles thorugh a hardcoded static block in the java code.

      It would be better to make this configurable, so you could add your own languages without recompiling.

      Suggested approach:
      Remove the static code block loading all languages. Instead look for a tika.languageidentification.properties file on classpath.
      Now the user can simply make his/her own (additional) language profile files, put them on the classpath together with a properties file and off you go!

      Also, once you make it configurable, there might be an issue of having the profiles as static members, as you will force the same behaviour for the whole VM. A static Map of Maps could solve this.

        Attachments

        1. TIKA-490.patch
          8 kB
          Jan Høydahl
        2. TIKA-490.patch
          8 kB
          Jan Høydahl
        3. TIKA-490.Mattmann.082210.patch.txt
          10 kB
          Chris A. Mattmann
        4. TIKA-490.Mattmann.082210.2.patch.txt
          11 kB
          Chris A. Mattmann
        5. TIKA-490.janhoy.092010.patch
          14 kB
          Jan Høydahl
        6. TIKA-490.janhoy.092010.patch
          14 kB
          Jan Høydahl
        7. TIKA-490.janhoy.082310.patch
          12 kB
          Jan Høydahl
        8. TIKA-490.janhoy.082310.patch
          12 kB
          Jan Høydahl

          Activity

            People

            • Assignee:
              chrismattmann Chris A. Mattmann
              Reporter:
              janhoy Jan Høydahl
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified