OpenNLP
  1. OpenNLP
  2. OPENNLP-338

Add L-BFGS parameter estimation training to maxent

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: tools-1.5.3
    • Component/s: Machine Learning
    • Labels:
      None

      Description

      Add support for the L-BFGS algorithm to train a maxent classifier.

      1. LogLikelihoodFunctionTest.patch
        5 kB
        Hyosup Shim
      2. LogLikelihoodFunctionTest.patch.2
        1 kB
        Hyosup Shim
      3. nl-per.testa
        231 kB
        Joern Kottmann
      4. nl-per.testb
        411 kB
        Joern Kottmann
      5. nl-per.train
        1.18 MB
        Joern Kottmann
      6. patch20120814-lbfgs.txt
        68 kB
        Hyosup Shim
      7. patch20120821-lbfgs
        76 kB
        Hyosup Shim
      8. patch-lbfgs.txt
        52 kB
        Hyosup Shim
      9. precision_curve_on_iteration.png
        30 kB
        Hyosup Shim

        Issue Links

          Activity

          Joern Kottmann created issue -
          Hyosup Shim made changes -
          Field Original Value New Value
          Attachment patch-lbfgs.txt [ 12540592 ]
          Hyosup Shim made changes -
          Attachment patch20120814-lbfgs.txt [ 12540845 ]
          Hyosup Shim made changes -
          Attachment patch20120814-lbfgs.txt [ 12540845 ]
          Hyosup Shim made changes -
          Attachment patch20120814-lbfgs.txt [ 12540846 ]
          Joern Kottmann made changes -
          Fix Version/s tools-1.5.3 [ 12319040 ]
          Joern Kottmann made changes -
          Assignee Hyosup Shim [ flourscent ]
          Joern Kottmann made changes -
          Attachment nl-per.testa [ 12540874 ]
          Attachment nl-per.testb [ 12540875 ]
          Attachment nl-per.train [ 12540876 ]
          Hyosup Shim made changes -
          Attachment patch20120815-lbfgs [ 12541009 ]
          Hyosup Shim made changes -
          Attachment patch20120815-lbfgs [ 12541009 ]
          Hyosup Shim made changes -
          Comment [ I made modification in QNModel its excessive memory use,
          and TrainUtil to create proper trainer object.
          So I think that I solved the problem raises exceptions that you showed me.

          I tested it, it built model file successfully, but in assessment phase, I got following exception.
          Can you tell me what went wrong this time please?

          C:\Users\Hyosup\Desktop\apache-opennlp-1.5.3-SNAPSHOT>bin\opennlp TokenNameFinde
          rEvaluator -model qn-test.bin -data nl-per.testa -lang nl
          Loading Token Name Finder model ... done (1.324s)
          Exception in thread "main" java.lang.NullPointerException
                  at opennlp.tools.namefind.NameFinderME.find(NameFinderME.java:223)
                  at opennlp.tools.namefind.NameFinderME.find(NameFinderME.java:205)
                  at opennlp.tools.namefind.TokenNameFinderEvaluator.processSample(TokenNa
          meFinderEvaluator.java:84)
                  at opennlp.tools.namefind.TokenNameFinderEvaluator.processSample(TokenNa
          meFinderEvaluator.java:43)
                  at opennlp.tools.util.eval.Evaluator.evaluateSample(Evaluator.java:82)
                  at opennlp.tools.util.eval.Evaluator.evaluate(Evaluator.java:109)
                  at opennlp.tools.cmdline.namefind.TokenNameFinderEvaluatorTool.run(Token
          NameFinderEvaluatorTool.java:92)
                  at opennlp.tools.cmdline.CLI.main(CLI.java:222) ]
          Hyosup Shim made changes -
          Comment [ I am testing the TokenNameFinderEvaluator job in IDE. this time, no exception rises, just "sent" count in increasing. ]
          Hyosup Shim made changes -
          Attachment patch20120821-lbfgs [ 12541601 ]
          Hyosup Shim made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          Hyosup Shim made changes -
          Attachment precision_curve_on_iteration.png [ 12542440 ]
          Hyosup Shim made changes -
          Status In Progress [ 3 ] Open [ 1 ]
          Hyosup Shim made changes -
          Attachment precision_curve_on_iteration.png [ 12542440 ]
          Hyosup Shim made changes -
          Attachment precision_curve_on_iteration.png [ 12542441 ]
          Hyosup Shim made changes -
          Attachment LogLikelihoodFunctionTest.patch [ 12547719 ]
          Hyosup Shim made changes -
          Attachment LogLikelihoodFunctionTest.patch.2 [ 12547724 ]
          Hyosup Shim made changes -
          Status Open [ 1 ] Closed [ 6 ]
          Resolution Fixed [ 1 ]
          Joern Kottmann made changes -
          Link This issue relates to OPENNLP-569 [ OPENNLP-569 ]

            People

            • Assignee:
              Hyosup Shim
              Reporter:
              Joern Kottmann
            • Votes:
              2 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development