Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      I think it'd be useful to have a "demo" search server for Lucene.

      Rather than being fully featured, like Solr, it would be minimal, just wrapping the existing Lucene modules to show how you can make use of these features in a server setting.

      The purpose is to demonstrate how one can build a minimal search server on top of APIs like SearchManager, SearcherLifetimeManager, etc.

      This is also useful for finding rough edges / issues in Lucene's APIs that make building a server unnecessarily hard.

      I don't think it should have back compatibility promises (except Lucene's index back compatibility), so it's free to improve as Lucene's APIs change.

      As a starting point, I'll post what I built for the "eating your own dog food" search app for Lucene's & Solr's jira issues http://jirasearch.mikemccandless.com (blog: http://blog.mikemccandless.com/2013/05/eating-dog-food-with-lucene.html ). It uses Netty to expose basic indexing & searching APIs via JSON, but it's very rough (lots nocommits).

      1. lucene-demo-server.tgz
        136 kB
        Michael McCandless

        Activity

        Hide
        Vincent Murphy added a comment -
        Show
        Vincent Murphy added a comment - Just looking for the code? https://github.com/apache/lucene-solr/tree/lucene5376_2
        Hide
        ASF subversion and git services added a comment -

        Commit 1591986 from jdyer@apache.org in branch 'dev/branches/lucene5376_2'
        [ https://svn.apache.org/r1591986 ]

        LUCENE-5376: convert GET parameters to JSON

        Show
        ASF subversion and git services added a comment - Commit 1591986 from jdyer@apache.org in branch 'dev/branches/lucene5376_2' [ https://svn.apache.org/r1591986 ] LUCENE-5376 : convert GET parameters to JSON
        Hide
        ASF subversion and git services added a comment -

        Commit 1591984 from jdyer@apache.org in branch 'dev/branches/lucene5376_2'
        [ https://svn.apache.org/r1591984 ]

        LUCENE-5376: HelpHandler fix for incoming parameter

        Show
        ASF subversion and git services added a comment - Commit 1591984 from jdyer@apache.org in branch 'dev/branches/lucene5376_2' [ https://svn.apache.org/r1591984 ] LUCENE-5376 : HelpHandler fix for incoming parameter
        Hide
        ASF subversion and git services added a comment -

        Commit 1591764 from jdyer@apache.org in branch 'dev/branches/lucene5376_2'
        [ https://svn.apache.org/r1591764 ]

        LUCENE-5376: HelpHandler fixes

        Show
        ASF subversion and git services added a comment - Commit 1591764 from jdyer@apache.org in branch 'dev/branches/lucene5376_2' [ https://svn.apache.org/r1591764 ] LUCENE-5376 : HelpHandler fixes
        Hide
        ASF subversion and git services added a comment -

        Commit 1591762 from jdyer@apache.org in branch 'dev/branches/lucene5376_2'
        [ https://svn.apache.org/r1591762 ]

        LUCENE-5376: add HelpHandler to aid new users and provide quick reference

        Show
        ASF subversion and git services added a comment - Commit 1591762 from jdyer@apache.org in branch 'dev/branches/lucene5376_2' [ https://svn.apache.org/r1591762 ] LUCENE-5376 : add HelpHandler to aid new users and provide quick reference
        Hide
        Michael McCandless added a comment -

        Thanks James!

        If user doesn't specify a handler, or an invalid one, return a list of valid handlers, possibly with a little param documentation instead of the current IllegalArgumentException

        +1: it's really important that all errors that come back from the server are transparent/clear as possible. Maybe point to the live docs handler?

        Allow commands like "createIndex" be execute as GET and not require POST. Maybe let users pass parameters on the URL and not always expect an incoming JSON document? And/or have a parameter "json" for such a document?

        I think this makes sense as long as the GET API is just a mirror of what you could do via JSON? E.g., maybe take all CGI args, turn into the corresponding JSON struct, and pretend that JSON had arrived via POST? Something like that ...

        Show
        Michael McCandless added a comment - Thanks James! If user doesn't specify a handler, or an invalid one, return a list of valid handlers, possibly with a little param documentation instead of the current IllegalArgumentException +1: it's really important that all errors that come back from the server are transparent/clear as possible. Maybe point to the live docs handler? Allow commands like "createIndex" be execute as GET and not require POST. Maybe let users pass parameters on the URL and not always expect an incoming JSON document? And/or have a parameter "json" for such a document? I think this makes sense as long as the GET API is just a mirror of what you could do via JSON? E.g., maybe take all CGI args, turn into the corresponding JSON struct, and pretend that JSON had arrived via POST? Something like that ...
        Hide
        James Dyer added a comment -

        Just playing around with this a little bit. I'm running into some barriers for a quick start, wonder if we could...

        • If user doesn't specify a handler, or an invalid one, return a list of valid handlers, possibly with a little param documentation instead of the current IllegalArgumentException
        • Allow commands like "createIndex" be execute as GET and not require POST. Maybe let users pass parameters on the URL and not always expect an incoming JSON document? And/or have a parameter "json" for such a document?

        I'd be happy to try and add this but wasn't sure if the intent was to make this strictly a server-to-server app, or also something users could play around with interactively with a browser.

        Show
        James Dyer added a comment - Just playing around with this a little bit. I'm running into some barriers for a quick start, wonder if we could... If user doesn't specify a handler, or an invalid one, return a list of valid handlers, possibly with a little param documentation instead of the current IllegalArgumentException Allow commands like "createIndex" be execute as GET and not require POST. Maybe let users pass parameters on the URL and not always expect an incoming JSON document? And/or have a parameter "json" for such a document? I'd be happy to try and add this but wasn't sure if the intent was to make this strictly a server-to-server app, or also something users could play around with interactively with a browser.
        Hide
        ASF subversion and git services added a comment -

        Commit 1591292 from jdyer@apache.org in branch 'dev/branches/lucene5376_2'
        [ https://svn.apache.org/r1591292 ]

        LUCENE-5376: Use a default 'stateDir' instead of throwing NPE

        Show
        ASF subversion and git services added a comment - Commit 1591292 from jdyer@apache.org in branch 'dev/branches/lucene5376_2' [ https://svn.apache.org/r1591292 ] LUCENE-5376 : Use a default 'stateDir' instead of throwing NPE
        Hide
        ASF subversion and git services added a comment -

        Commit 1591283 from jdyer@apache.org in branch 'dev/branches/lucene5376_2'
        [ https://svn.apache.org/r1591283 ]

        LUCENE-5376: add "lib" directory to svn:ignore

        Show
        ASF subversion and git services added a comment - Commit 1591283 from jdyer@apache.org in branch 'dev/branches/lucene5376_2' [ https://svn.apache.org/r1591283 ] LUCENE-5376 : add "lib" directory to svn:ignore
        Hide
        ASF subversion and git services added a comment -

        Commit 1579299 from Michael McCandless in branch 'dev/branches/lucene5376_2'
        [ https://svn.apache.org/r1579299 ]

        LUCENE-5376: add missing cause for some exceptions

        Show
        ASF subversion and git services added a comment - Commit 1579299 from Michael McCandless in branch 'dev/branches/lucene5376_2' [ https://svn.apache.org/r1579299 ] LUCENE-5376 : add missing cause for some exceptions
        Hide
        Chris Male added a comment -

        Sweet!

        Show
        Chris Male added a comment - Sweet!
        Hide
        Michael McCandless added a comment -

        What's motivated the new branch?

        Oh, sorry, something went wrong with the merge props on the old branch, such that when I tried to merge as I always do ("svn merge ../trunk") it hit strange conflicts in files never changed on the branch and then stopped merging and asked me to resolve the conflicts and re-run the merge, which caused further conflicts in files that shouldn't have conflicted...

        I figured it was easier to just rebranch.

        Show
        Michael McCandless added a comment - What's motivated the new branch? Oh, sorry, something went wrong with the merge props on the old branch, such that when I tried to merge as I always do ("svn merge ../trunk") it hit strange conflicts in files never changed on the branch and then stopped merging and asked me to resolve the conflicts and re-run the merge, which caused further conflicts in files that shouldn't have conflicted... I figured it was easier to just rebranch.
        Hide
        Chris Male added a comment - - edited

        What's motivated the new branch?

        Show
        Chris Male added a comment - - edited What's motivated the new branch?
        Hide
        ASF subversion and git services added a comment -

        Commit 1578144 from Michael McCandless in branch 'dev/branches/lucene5376_2'
        [ https://svn.apache.org/r1578144 ]

        LUCENE-5376: merge trunk

        Show
        ASF subversion and git services added a comment - Commit 1578144 from Michael McCandless in branch 'dev/branches/lucene5376_2' [ https://svn.apache.org/r1578144 ] LUCENE-5376 : merge trunk
        Hide
        ASF subversion and git services added a comment -

        Commit 1578133 from Michael McCandless in branch 'dev/branches/lucene5376_2'
        [ https://svn.apache.org/r1578133 ]

        LUCENE-5376: carry over last branch

        Show
        ASF subversion and git services added a comment - Commit 1578133 from Michael McCandless in branch 'dev/branches/lucene5376_2' [ https://svn.apache.org/r1578133 ] LUCENE-5376 : carry over last branch
        Hide
        ASF subversion and git services added a comment -

        Commit 1578132 from Michael McCandless in branch 'dev/branches/lucene5376_2'
        [ https://svn.apache.org/r1578132 ]

        LUCENE-5376: make new branch

        Show
        ASF subversion and git services added a comment - Commit 1578132 from Michael McCandless in branch 'dev/branches/lucene5376_2' [ https://svn.apache.org/r1578132 ] LUCENE-5376 : make new branch
        Hide
        ASF subversion and git services added a comment -

        Commit 1573227 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1573227 ]

        LUCENE-5376: expose set/getCommitUserData

        Show
        ASF subversion and git services added a comment - Commit 1573227 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1573227 ] LUCENE-5376 : expose set/getCommitUserData
        Hide
        ASF subversion and git services added a comment -

        Commit 1573080 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1573080 ]

        LUCENE-5376, LUCENE-5477: add near-real-time suggest updates when using AnalyzingInfixSuggester to Lucene demo server

        Show
        ASF subversion and git services added a comment - Commit 1573080 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1573080 ] LUCENE-5376 , LUCENE-5477 : add near-real-time suggest updates when using AnalyzingInfixSuggester to Lucene demo server
        Hide
        ASF subversion and git services added a comment -

        Commit 1573003 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1573003 ]

        LUCENE-5376: merge trunk

        Show
        ASF subversion and git services added a comment - Commit 1573003 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1573003 ] LUCENE-5376 : merge trunk
        Hide
        Michael McCandless added a comment -

        What's the endzone here? Any thoughts on it coming back into trunk?

        Yes, I'd like to land it in trunk / 4.x, but it's probably going to be a while still ... lots of nocommits, though probably most could be downgraded to TODOs.

        The server works well (it's running at http://jirasearch.mikemccandless.com), and is a nice showcase of many Lucene modules (faceting, expressions, joins, grouping, highlighting, etc.). It's also helped uncover a number of "rough edges" in Lucene...

        Show
        Michael McCandless added a comment - What's the endzone here? Any thoughts on it coming back into trunk? Yes, I'd like to land it in trunk / 4.x, but it's probably going to be a while still ... lots of nocommits, though probably most could be downgraded to TODOs. The server works well (it's running at http://jirasearch.mikemccandless.com ), and is a nice showcase of many Lucene modules (faceting, expressions, joins, grouping, highlighting, etc.). It's also helped uncover a number of "rough edges" in Lucene...
        Hide
        Chris Male added a comment -

        Hey Mike,

        What's the endzone here? Any thoughts on it coming back into trunk?

        Show
        Chris Male added a comment - Hey Mike, What's the endzone here? Any thoughts on it coming back into trunk?
        Hide
        ASF subversion and git services added a comment -

        Commit 1572637 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1572637 ]

        LUCENE-5376: add factory for SuggestStopFilter; get PostingsHighlighter MTQ highlighting working with block join queries; fix 0.0 score from block join group parent; add explicit label faceting; fix analyzing infix suggester highlighting; allow drill-downs on range facets

        Show
        ASF subversion and git services added a comment - Commit 1572637 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1572637 ] LUCENE-5376 : add factory for SuggestStopFilter; get PostingsHighlighter MTQ highlighting working with block join queries; fix 0.0 score from block join group parent; add explicit label faceting; fix analyzing infix suggester highlighting; allow drill-downs on range facets
        Hide
        ASF subversion and git services added a comment -

        Commit 1572063 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1572063 ]

        LUCENE-5376: sync trunk

        Show
        ASF subversion and git services added a comment - Commit 1572063 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1572063 ] LUCENE-5376 : sync trunk
        Hide
        ASF subversion and git services added a comment -

        Commit 1566454 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1566454 ]

        LUCENE-5376: sync trunk

        Show
        ASF subversion and git services added a comment - Commit 1566454 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1566454 ] LUCENE-5376 : sync trunk
        Hide
        ASF subversion and git services added a comment -

        Commit 1565325 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1565325 ]

        LUCENE-5376: add some more test cases for dynamic expressions; clean up test code

        Show
        ASF subversion and git services added a comment - Commit 1565325 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1565325 ] LUCENE-5376 : add some more test cases for dynamic expressions; clean up test code
        Hide
        ASF subversion and git services added a comment -

        Commit 1565184 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1565184 ]

        LUCENE-5376: merge trunk

        Show
        ASF subversion and git services added a comment - Commit 1565184 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1565184 ] LUCENE-5376 : merge trunk
        Hide
        ASF subversion and git services added a comment -

        Commit 1564769 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1564769 ]

        LUCENE-5376: minor cleanups in replication

        Show
        ASF subversion and git services added a comment - Commit 1564769 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1564769 ] LUCENE-5376 : minor cleanups in replication
        Hide
        ASF subversion and git services added a comment -

        Commit 1563248 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1563248 ]

        LUCENE-5376: merge trunk

        Show
        ASF subversion and git services added a comment - Commit 1563248 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1563248 ] LUCENE-5376 : merge trunk
        Hide
        ASF subversion and git services added a comment -

        Commit 1563180 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1563180 ]

        LUCENE-5415,LUCENE-5376: get MultiTermQuery highlighting working; fix compilation errors

        Show
        ASF subversion and git services added a comment - Commit 1563180 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1563180 ] LUCENE-5415 , LUCENE-5376 : get MultiTermQuery highlighting working; fix compilation errors
        Hide
        ASF subversion and git services added a comment -

        Commit 1562403 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1562403 ]

        LUCENE-5376: sync trunk

        Show
        ASF subversion and git services added a comment - Commit 1562403 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1562403 ] LUCENE-5376 : sync trunk
        Hide
        Michael McCandless added a comment -

        Hi Arcadius, the server is currently not a webapp; you don't drop it into any web container to run it.

        Instead, its a standalone app, using Netty for the HTTP interface; run it like this:

            java -cp ... org.apache.lucene.server.Server -port NNNN -stateDir /path/to/dir
        

        You'll need to put a bunch of Lucene's JARs on the classpath since the server exposes most of Lucene's modules (grouping, joins, analysis, highlighter, facets, queries, queryparser, suggest, expressions), as well as the jars under lucene/server/lib after you've run "ant resolve".

        Show
        Michael McCandless added a comment - Hi Arcadius, the server is currently not a webapp; you don't drop it into any web container to run it. Instead, its a standalone app, using Netty for the HTTP interface; run it like this: java -cp ... org.apache.lucene.server.Server -port NNNN -stateDir /path/to/dir You'll need to put a bunch of Lucene's JARs on the classpath since the server exposes most of Lucene's modules (grouping, joins, analysis, highlighter, facets, queries, queryparser, suggest, expressions), as well as the jars under lucene/server/lib after you've run "ant resolve".
        Hide
        Arcadius Ahouansou added a comment -

        Hello.

        I have checked out this branch and did in the lucene directory an
        ant clean package-zip
        The build was successful and many artefacts were created including:

        • lucene-xml-query-demo.war
        • lucene-demo-5.0-SNAPSHOT.jar
        • lucene-server-5.0-SNAPSHOT.jar

        I dropped the war into a fresh jetty 9 install and jetty was not happy (see stacktrace below).

        My questions is:

        • How the demo and the new server package fit together?
        • How to run the demo?

        Thanks.

                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
                at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
                at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
                at java.lang.reflect.Method.invoke(Unknown Source)
                at org.eclipse.jetty.start.Main.invokeMain(Main.java:297)
                at org.eclipse.jetty.start.Main.start(Main.java:724)
                at org.eclipse.jetty.start.Main.main(Main.java:103)
                2014-01-27 22:21:36.288:WARN:lucene-xml-query-demo:main: unavailable
                javax.servlet.UnavailableException: org.apache.lucene.xmlparser.webdemo.FormBasedXmlQueryDemo
                at org.eclipse.jetty.servlet.BaseHolder.doStart(BaseHolder.java:102)
                at org.eclipse.jetty.servlet.ServletHolder.doStart(ServletHolder.java:294)
        
        Show
        Arcadius Ahouansou added a comment - Hello. I have checked out this branch and did in the lucene directory an ant clean package-zip The build was successful and many artefacts were created including: lucene-xml-query-demo.war lucene-demo-5.0-SNAPSHOT.jar lucene-server-5.0-SNAPSHOT.jar I dropped the war into a fresh jetty 9 install and jetty was not happy (see stacktrace below). My questions is: How the demo and the new server package fit together? How to run the demo? Thanks. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.eclipse.jetty.start.Main.invokeMain(Main.java:297) at org.eclipse.jetty.start.Main.start(Main.java:724) at org.eclipse.jetty.start.Main.main(Main.java:103) 2014-01-27 22:21:36.288:WARN:lucene-xml-query-demo:main: unavailable javax.servlet.UnavailableException: org.apache.lucene.xmlparser.webdemo.FormBasedXmlQueryDemo at org.eclipse.jetty.servlet.BaseHolder.doStart(BaseHolder.java:102) at org.eclipse.jetty.servlet.ServletHolder.doStart(ServletHolder.java:294)
        Hide
        ASF subversion and git services added a comment -

        Commit 1561529 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1561529 ]

        LUCENE-5376: relax type DocsEnum -> DocIdSetIterator; fix typos

        Show
        ASF subversion and git services added a comment - Commit 1561529 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1561529 ] LUCENE-5376 : relax type DocsEnum -> DocIdSetIterator; fix typos
        Hide
        ASF subversion and git services added a comment -

        Commit 1561524 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1561524 ]

        LUCENE-5376: add some nocommits; cutover another pretty-print from jackson to json-smart; small simplification to replication

        Show
        ASF subversion and git services added a comment - Commit 1561524 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1561524 ] LUCENE-5376 : add some nocommits; cutover another pretty-print from jackson to json-smart; small simplification to replication
        Hide
        ASF subversion and git services added a comment -

        Commit 1560946 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1560946 ]

        LUCENE-5376: improve comments / nocommits

        Show
        ASF subversion and git services added a comment - Commit 1560946 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1560946 ] LUCENE-5376 : improve comments / nocommits
        Hide
        ASF subversion and git services added a comment -

        Commit 1559984 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1559984 ]

        LUCENE-5376: finish the simple distance range facets example; fix pre-existing bug when range facet filters are used with drill sideways

        Show
        ASF subversion and git services added a comment - Commit 1559984 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1559984 ] LUCENE-5376 : finish the simple distance range facets example; fix pre-existing bug when range facet filters are used with drill sideways
        Hide
        ASF subversion and git services added a comment -

        Commit 1559973 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1559973 ]

        LUCENE-5376: add search timeout (TimeLimitingCollector)

        Show
        ASF subversion and git services added a comment - Commit 1559973 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1559973 ] LUCENE-5376 : add search timeout (TimeLimitingCollector)
        Hide
        ASF subversion and git services added a comment -

        Commit 1559805 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1559805 ]

        LUCENE-5376: show how to do distance drill down with lucene server; clean up some tests

        Show
        ASF subversion and git services added a comment - Commit 1559805 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1559805 ] LUCENE-5376 : show how to do distance drill down with lucene server; clean up some tests
        Hide
        ASF subversion and git services added a comment -

        Commit 1559670 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1559670 ]

        LUCENE-5376: get 'file-like resources' working with char filters, fix nocommits, tests, clean up the analysis factory code

        Show
        ASF subversion and git services added a comment - Commit 1559670 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1559670 ] LUCENE-5376 : get 'file-like resources' working with char filters, fix nocommits, tests, clean up the analysis factory code
        Hide
        ASF subversion and git services added a comment -

        Commit 1559542 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1559542 ]

        LUCENE-5376: always throw unchecked cause of the InvocationTargetException

        Show
        ASF subversion and git services added a comment - Commit 1559542 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1559542 ] LUCENE-5376 : always throw unchecked cause of the InvocationTargetException
        Hide
        ASF subversion and git services added a comment -

        Commit 1559524 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1559524 ]

        LUCENE-5376: cutover to analysis factories to create tokenizer and token filters; still need char filters & whole analyzers

        Show
        ASF subversion and git services added a comment - Commit 1559524 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1559524 ] LUCENE-5376 : cutover to analysis factories to create tokenizer and token filters; still need char filters & whole analyzers
        Hide
        Michael McCandless added a comment -

        LUCENE-5404 adds support for counting # of entries a lookup was built with and returns it on the build command, Dictionary uses InputIterator instead of BytesRefIterator among other things. I think it will get rid of some nocommits here?

        Wow, super, this will fix a few nocommits in the server. Thanks Areek, I'll have a look!

        Show
        Michael McCandless added a comment - LUCENE-5404 adds support for counting # of entries a lookup was built with and returns it on the build command, Dictionary uses InputIterator instead of BytesRefIterator among other things. I think it will get rid of some nocommits here? Wow, super, this will fix a few nocommits in the server. Thanks Areek, I'll have a look!
        Hide
        Areek Zillur added a comment -

        LUCENE-5404 adds support for counting # of entries a lookup was built with and returns it on the build command, Dictionary uses InputIterator instead of BytesRefIterator among other things. I think it will get rid of some nocommits here?

        Show
        Areek Zillur added a comment - LUCENE-5404 adds support for counting # of entries a lookup was built with and returns it on the build command, Dictionary uses InputIterator instead of BytesRefIterator among other things. I think it will get rid of some nocommits here?
        Hide
        ASF subversion and git services added a comment -

        Commit 1559196 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1559196 ]

        LUCENE-5376, LUCENE-5399: add missingLast support to lucene server

        Show
        ASF subversion and git services added a comment - Commit 1559196 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1559196 ] LUCENE-5376 , LUCENE-5399 : add missingLast support to lucene server
        Hide
        ASF subversion and git services added a comment -

        Commit 1557868 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1557868 ]

        LUCENE-5376: add merge max MB/sec rate limiting

        Show
        ASF subversion and git services added a comment - Commit 1557868 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1557868 ] LUCENE-5376 : add merge max MB/sec rate limiting
        Hide
        ASF subversion and git services added a comment -

        Commit 1557855 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1557855 ]

        LUCENE-5376: all custom Directory implementations accessible in CP; always return suggest count from buildSuggest; fix highlighting in AnalyzingInfixSuggster to render strait to JSONObject; add HTTP compression nocommits

        Show
        ASF subversion and git services added a comment - Commit 1557855 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1557855 ] LUCENE-5376 : all custom Directory implementations accessible in CP; always return suggest count from buildSuggest; fix highlighting in AnalyzingInfixSuggster to render strait to JSONObject; add HTTP compression nocommits
        Hide
        ASF subversion and git services added a comment -

        Commit 1557694 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1557694 ]

        LUCENE-5376: fix nocommits, add tests, get RAMDir indices working more correctly; rename 'index' param to 'search' when registering a field

        Show
        ASF subversion and git services added a comment - Commit 1557694 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1557694 ] LUCENE-5376 : fix nocommits, add tests, get RAMDir indices working more correctly; rename 'index' param to 'search' when registering a field
        Hide
        ASF subversion and git services added a comment -

        Commit 1557517 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1557517 ]

        LUCENE-5376: expose control over underlying facet index field, fix some nocommits

        Show
        ASF subversion and git services added a comment - Commit 1557517 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1557517 ] LUCENE-5376 : expose control over underlying facet index field, fix some nocommits
        Hide
        ASF subversion and git services added a comment -

        Commit 1557073 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1557073 ]

        LUCENE-5336, LUCENE-5376: expose SimpleQueryParser in lucene server

        Show
        ASF subversion and git services added a comment - Commit 1557073 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1557073 ] LUCENE-5336 , LUCENE-5376 : expose SimpleQueryParser in lucene server
        Hide
        ASF subversion and git services added a comment -

        Commit 1556786 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1556786 ]

        LUCENE-4906, LUCENE-5376: using the expert 'render to Object' APIs in PostingsHighlighter to render directly to JSONArray in lucene server

        Show
        ASF subversion and git services added a comment - Commit 1556786 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1556786 ] LUCENE-4906 , LUCENE-5376 : using the expert 'render to Object' APIs in PostingsHighlighter to render directly to JSONArray in lucene server
        Hide
        ASF subversion and git services added a comment -

        Commit 1556775 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1556775 ]

        LUCENE-5376: allow setting norms format, including compressed norms

        Show
        ASF subversion and git services added a comment - Commit 1556775 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1556775 ] LUCENE-5376 : allow setting norms format, including compressed norms
        Hide
        ASF subversion and git services added a comment -

        Commit 1556627 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1556627 ]

        LUCENE-5376: remove recency blending hack: just use expressions instead

        Show
        ASF subversion and git services added a comment - Commit 1556627 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1556627 ] LUCENE-5376 : remove recency blending hack: just use expressions instead
        Hide
        ASF subversion and git services added a comment -

        Commit 1556620 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1556620 ]

        LUCENE-5376: also allow dynamic expression per-request

        Show
        ASF subversion and git services added a comment - Commit 1556620 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1556620 ] LUCENE-5376 : also allow dynamic expression per-request
        Hide
        ASF subversion and git services added a comment -

        Commit 1556564 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1556564 ]

        LUCENE-5376: add another expression test case; add nocommit for bcp47 cutover

        Show
        ASF subversion and git services added a comment - Commit 1556564 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1556564 ] LUCENE-5376 : add another expression test case; add nocommit for bcp47 cutover
        Hide
        ASF subversion and git services added a comment -

        Commit 1556555 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1556555 ]

        LUCENE-5376: don't need to make ScoreValueSource public

        Show
        ASF subversion and git services added a comment - Commit 1556555 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1556555 ] LUCENE-5376 : don't need to make ScoreValueSource public
        Hide
        ASF subversion and git services added a comment -

        Commit 1556546 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1556546 ]

        LUCENE-5376: turn on scoring when sorting by field if any of the sort fields or retrieved fields require scores, e.g. when they are an expression field that uses _score

        Show
        ASF subversion and git services added a comment - Commit 1556546 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1556546 ] LUCENE-5376 : turn on scoring when sorting by field if any of the sort fields or retrieved fields require scores, e.g. when they are an expression field that uses _score
        Hide
        ASF subversion and git services added a comment -

        Commit 1556508 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1556508 ]

        LUCENE-5207, LUCENE-5376: add expressions support to lucene server, so you can define a virtual field from any JS expression and then sort by that field or retrieve its values for all hits

        Show
        ASF subversion and git services added a comment - Commit 1556508 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1556508 ] LUCENE-5207 , LUCENE-5376 : add expressions support to lucene server, so you can define a virtual field from any JS expression and then sort by that field or retrieve its values for all hits
        Hide
        ASF subversion and git services added a comment -

        Commit 1556045 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1556045 ]

        LUCENE-4795, LUCENE-5376: expose SortedSetDocValuesFacets in lucene server

        Show
        ASF subversion and git services added a comment - Commit 1556045 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1556045 ] LUCENE-4795 , LUCENE-5376 : expose SortedSetDocValuesFacets in lucene server
        Hide
        ASF subversion and git services added a comment -

        Commit 1555726 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1555726 ]

        LUCENE-5376: consolidate logic to pull the searcher from indexGen, version, snapshot or current

        Show
        ASF subversion and git services added a comment - Commit 1555726 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1555726 ] LUCENE-5376 : consolidate logic to pull the searcher from indexGen, version, snapshot or current
        Hide
        ASF subversion and git services added a comment -

        Commit 1555629 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1555629 ]

        LUCENE-5376: sync trunk changes, cutover to new facets APIs, simplify search handler

        Show
        ASF subversion and git services added a comment - Commit 1555629 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1555629 ] LUCENE-5376 : sync trunk changes, cutover to new facets APIs, simplify search handler
        Hide
        ASF subversion and git services added a comment -

        Commit 1555341 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1555341 ]

        LUCENE-5376: test sugar: insert the current index name to outgoing requests to make writing tests easier

        Show
        ASF subversion and git services added a comment - Commit 1555341 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1555341 ] LUCENE-5376 : test sugar: insert the current index name to outgoing requests to make writing tests easier
        Hide
        ASF subversion and git services added a comment -

        Commit 1554409 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1554409 ]

        LUCENE-5294, LUCENE-5376: in Lucene demo server, support building suggester where weight is an expression

        Show
        ASF subversion and git services added a comment - Commit 1554409 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1554409 ] LUCENE-5294 , LUCENE-5376 : in Lucene demo server, support building suggester where weight is an expression
        Hide
        ASF subversion and git services added a comment -

        Commit 1554207 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1554207 ]

        LUCENE-5376, LUCENE-5251: expose DocumentDictionary (to build suggestor from stored documents) in demo server

        Show
        ASF subversion and git services added a comment - Commit 1554207 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1554207 ] LUCENE-5376 , LUCENE-5251 : expose DocumentDictionary (to build suggestor from stored documents) in demo server
        Hide
        ASF subversion and git services added a comment -

        Commit 1554022 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1554022 ]

        LUCENE-5376: rename singleValued -> multiValued

        Show
        ASF subversion and git services added a comment - Commit 1554022 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1554022 ] LUCENE-5376 : rename singleValued -> multiValued
        Hide
        ASF subversion and git services added a comment -

        Commit 1554020 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1554020 ]

        LUCENE-5376: clean up / document addDocument code

        Show
        ASF subversion and git services added a comment - Commit 1554020 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1554020 ] LUCENE-5376 : clean up / document addDocument code
        Hide
        ASF subversion and git services added a comment -

        Commit 1554013 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1554013 ]

        LUCENE-5376: simplify sync'd code

        Show
        ASF subversion and git services added a comment - Commit 1554013 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1554013 ] LUCENE-5376 : simplify sync'd code
        Hide
        ASF subversion and git services added a comment -

        Commit 1554012 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1554012 ]

        LUCENE-5376: documentation-lint finally passes (method level)

        Show
        ASF subversion and git services added a comment - Commit 1554012 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1554012 ] LUCENE-5376 : documentation-lint finally passes (method level)
        Hide
        ASF subversion and git services added a comment -

        Commit 1553821 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553821 ]

        LUCENE-5376: javadocs

        Show
        ASF subversion and git services added a comment - Commit 1553821 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553821 ] LUCENE-5376 : javadocs
        Hide
        ASF subversion and git services added a comment -

        Commit 1553670 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553670 ]

        LUCENE-5376: javadocs

        Show
        ASF subversion and git services added a comment - Commit 1553670 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553670 ] LUCENE-5376 : javadocs
        Hide
        ASF subversion and git services added a comment -

        Commit 1553500 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553500 ]

        LUCENE-5376: don't create and destroy dirs in the CWD

        Show
        ASF subversion and git services added a comment - Commit 1553500 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553500 ] LUCENE-5376 : don't create and destroy dirs in the CWD
        Hide
        ASF subversion and git services added a comment -

        Commit 1553499 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553499 ]

        LUCENE-5376: move the hack wtf into one place

        Show
        ASF subversion and git services added a comment - Commit 1553499 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553499 ] LUCENE-5376 : move the hack wtf into one place
        Hide
        ASF subversion and git services added a comment -

        Commit 1553486 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553486 ]

        LUCENE-5376: javadocs fixes

        Show
        ASF subversion and git services added a comment - Commit 1553486 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553486 ] LUCENE-5376 : javadocs fixes
        Hide
        ASF subversion and git services added a comment -

        Commit 1553477 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553477 ]

        LUCENE-5376: javadocs

        Show
        ASF subversion and git services added a comment - Commit 1553477 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553477 ] LUCENE-5376 : javadocs
        Hide
        ASF subversion and git services added a comment -

        Commit 1553403 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553403 ]

        LUCENE-5376: fix and re-enable test

        Show
        ASF subversion and git services added a comment - Commit 1553403 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553403 ] LUCENE-5376 : fix and re-enable test
        Hide
        Robert Muir added a comment -

        I had to add jackson for streaming / incremental parsing for the bulk APIs ... I think (not sure!) that we should just move to jackson for everything, but I haven't started that yet. I'll look into it.

        OK, I may have sent this in the wrong direction with my latest commit, so just back it out if you want to move to jackson. I assumed the opposite, since jackson was only used in a few places. I will say I do prefer the simpler underengineered api of the json-smart vs the ... no comment... jackson, even if it has less features. Reminds me of HttpURLConnection vs httpclient.

        Show
        Robert Muir added a comment - I had to add jackson for streaming / incremental parsing for the bulk APIs ... I think (not sure!) that we should just move to jackson for everything, but I haven't started that yet. I'll look into it. OK, I may have sent this in the wrong direction with my latest commit, so just back it out if you want to move to jackson. I assumed the opposite, since jackson was only used in a few places. I will say I do prefer the simpler underengineered api of the json-smart vs the ... no comment... jackson, even if it has less features. Reminds me of HttpURLConnection vs httpclient.
        Hide
        Michael McCandless added a comment -

        i removed the tika plugin (for now). is this ok? we can make it a separate module?

        That's fine ... let's leave it for later?

        which json parser to keep? jackson is only used rarely, i assume this is the one to remove? We just have to change the indexing code now to remove those jars.

        I had to add jackson for streaming / incremental parsing for the bulk APIs ... I think (not sure!) that we should just move to jackson for everything, but I haven't started that yet. I'll look into it.

        forbidden-apis was angry about the SOPs. i tried to figure out which ones were intentional and which ones were not. you can see the list of files exempted in build.xml.

        Thanks for fixing!

        javadocs-lint is working but angry because mostly all javadocs (package.html's, class docs) are missing. this seems to need some help.

        I'll work on this.

        TestPlugins is disabled, but i think we can fix it if we build a .zip on-the-fly, pulling in MockPlugin.class and other files with .getResourceAsStream? Uwe will love this.

        That sounds great!

        Thanks Rob.

        Show
        Michael McCandless added a comment - i removed the tika plugin (for now). is this ok? we can make it a separate module? That's fine ... let's leave it for later? which json parser to keep? jackson is only used rarely, i assume this is the one to remove? We just have to change the indexing code now to remove those jars. I had to add jackson for streaming / incremental parsing for the bulk APIs ... I think (not sure!) that we should just move to jackson for everything, but I haven't started that yet. I'll look into it. forbidden-apis was angry about the SOPs. i tried to figure out which ones were intentional and which ones were not. you can see the list of files exempted in build.xml. Thanks for fixing! javadocs-lint is working but angry because mostly all javadocs (package.html's, class docs) are missing. this seems to need some help. I'll work on this. TestPlugins is disabled, but i think we can fix it if we build a .zip on-the-fly, pulling in MockPlugin.class and other files with .getResourceAsStream? Uwe will love this. That sounds great! Thanks Rob.
        Hide
        Robert Muir added a comment -

        I created 'lucene5376' branch (https://svn.apache.org/repos/asf/lucene/dev/branches/lucene5376) with the patch and cleaned up the build and so on.

        notes/questions:

        • i removed the tika plugin (for now). is this ok? we can make it a separate module?
        • which json parser to keep? jackson is only used rarely, i assume this is the one to remove? We just have to change the indexing code now to remove those jars.
        • forbidden-apis was angry about the SOPs. i tried to figure out which ones were intentional and which ones were not. you can see the list of files exempted in build.xml.
        • javadocs-lint is working but angry because mostly all javadocs (package.html's, class docs) are missing. this seems to need some help.
        • TestPlugins is disabled, but i think we can fix it if we build a .zip on-the-fly, pulling in MockPlugin.class and other files with .getResourceAsStream? Uwe will love this.
        Show
        Robert Muir added a comment - I created 'lucene5376' branch ( https://svn.apache.org/repos/asf/lucene/dev/branches/lucene5376 ) with the patch and cleaned up the build and so on. notes/questions: i removed the tika plugin (for now). is this ok? we can make it a separate module? which json parser to keep? jackson is only used rarely, i assume this is the one to remove? We just have to change the indexing code now to remove those jars. forbidden-apis was angry about the SOPs. i tried to figure out which ones were intentional and which ones were not. you can see the list of files exempted in build.xml. javadocs-lint is working but angry because mostly all javadocs (package.html's, class docs) are missing. this seems to need some help. TestPlugins is disabled, but i think we can fix it if we build a .zip on-the-fly, pulling in MockPlugin.class and other files with .getResourceAsStream? Uwe will love this.
        Hide
        ASF subversion and git services added a comment -

        Commit 1553384 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553384 ]

        LUCENE-5376: remove crazy use of jackson for pretty-printing. jackson only used in the indexing api now

        Show
        ASF subversion and git services added a comment - Commit 1553384 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553384 ] LUCENE-5376 : remove crazy use of jackson for pretty-printing. jackson only used in the indexing api now
        Hide
        ASF subversion and git services added a comment -

        Commit 1553379 from Michael McCandless in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553379 ]

        LUCENE-5376: try to address nocommit...

        Show
        ASF subversion and git services added a comment - Commit 1553379 from Michael McCandless in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553379 ] LUCENE-5376 : try to address nocommit...
        Hide
        Areek Zillur added a comment -

        This is a good idea. I was thinking of having a suggest demo in the lucene demo package! But this would be a good place to put it. I will look into the suggest stuff after a week or so.

        Show
        Areek Zillur added a comment - This is a good idea. I was thinking of having a suggest demo in the lucene demo package! But this would be a good place to put it. I will look into the suggest stuff after a week or so.
        Hide
        Shai Erera added a comment -

        I think we should put it under lucene/demo or lucene/server or something.

        I think we should put it under lucene/server. We can have the JIRA search example (or a simpler one) under demo if we really want to, but I think a LuceneServer is a good component by itself. First, we never know what it will turn out into, what APIs will be developed etc. Also, it would be nice to see clean examples of distributed search (simple, facet, spatial) as well as suggest (maybe even distributed suggest). So +1 for adding it as a new module.

        Show
        Shai Erera added a comment - I think we should put it under lucene/demo or lucene/server or something. I think we should put it under lucene/server. We can have the JIRA search example (or a simpler one) under demo if we really want to, but I think a LuceneServer is a good component by itself. First, we never know what it will turn out into, what APIs will be developed etc. Also, it would be nice to see clean examples of distributed search (simple, facet, spatial) as well as suggest (maybe even distributed suggest). So +1 for adding it as a new module.
        Hide
        ASF subversion and git services added a comment -

        Commit 1553301 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553301 ]

        LUCENE-5376: remove code duplication

        Show
        ASF subversion and git services added a comment - Commit 1553301 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553301 ] LUCENE-5376 : remove code duplication
        Hide
        ASF subversion and git services added a comment -

        Commit 1553300 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553300 ]

        LUCENE-5376: clean up forbidden system outs / logging

        Show
        ASF subversion and git services added a comment - Commit 1553300 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553300 ] LUCENE-5376 : clean up forbidden system outs / logging
        Hide
        ASF subversion and git services added a comment -

        Commit 1553297 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553297 ]

        LUCENE-5376: minimize jdocs deps, nuke unused imports

        Show
        ASF subversion and git services added a comment - Commit 1553297 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553297 ] LUCENE-5376 : minimize jdocs deps, nuke unused imports
        Hide
        ASF subversion and git services added a comment -

        Commit 1553294 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553294 ]

        LUCENE-5376: fix documentation-lint, rat-sources, remove python build, remove plugin (it can be a separate module?)

        Show
        ASF subversion and git services added a comment - Commit 1553294 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553294 ] LUCENE-5376 : fix documentation-lint, rat-sources, remove python build, remove plugin (it can be a separate module?)
        Hide
        ASF subversion and git services added a comment -

        Commit 1553291 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553291 ]

        LUCENE-5376: get ant javados passing

        Show
        ASF subversion and git services added a comment - Commit 1553291 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553291 ] LUCENE-5376 : get ant javados passing
        Hide
        ASF subversion and git services added a comment -

        Commit 1553289 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553289 ]

        LUCENE-5376: clean up some forbidden apis

        Show
        ASF subversion and git services added a comment - Commit 1553289 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553289 ] LUCENE-5376 : clean up some forbidden apis
        Hide
        ASF subversion and git services added a comment -

        Commit 1553288 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553288 ]

        LUCENE-5376: use consistent dependencies versions, dont download the internet

        Show
        ASF subversion and git services added a comment - Commit 1553288 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553288 ] LUCENE-5376 : use consistent dependencies versions, dont download the internet
        Hide
        ASF subversion and git services added a comment -

        Commit 1553287 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553287 ]

        LUCENE-5376: get tests passing

        Show
        ASF subversion and git services added a comment - Commit 1553287 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553287 ] LUCENE-5376 : get tests passing
        Hide
        ASF subversion and git services added a comment -

        Commit 1553283 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553283 ]

        LUCENE-5376: add svn:ignore

        Show
        ASF subversion and git services added a comment - Commit 1553283 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553283 ] LUCENE-5376 : add svn:ignore
        Hide
        ASF subversion and git services added a comment -

        Commit 1553282 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553282 ]

        LUCENE-5376: fix compile

        Show
        ASF subversion and git services added a comment - Commit 1553282 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553282 ] LUCENE-5376 : fix compile
        Hide
        ASF subversion and git services added a comment -

        Commit 1553275 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553275 ]

        LUCENE-5376: fixup the ant/ivy a bit

        Show
        ASF subversion and git services added a comment - Commit 1553275 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553275 ] LUCENE-5376 : fixup the ant/ivy a bit
        Hide
        ASF subversion and git services added a comment -

        Commit 1553272 from Robert Muir in branch 'dev/branches/lucene5376'
        [ https://svn.apache.org/r1553272 ]

        LUCENE-5376: mike's tgz as-is to branch

        Show
        ASF subversion and git services added a comment - Commit 1553272 from Robert Muir in branch 'dev/branches/lucene5376' [ https://svn.apache.org/r1553272 ] LUCENE-5376 : mike's tgz as-is to branch
        Hide
        Yonik Seeley added a comment -

        I think there are plenty of lucene-based search servers already in existence... We shouldn't bloat lucene/solr even further by adding yet another. Something like this belongs as a separate project (collaborate on github with whoever else wants to build/maintain this).

        Show
        Yonik Seeley added a comment - I think there are plenty of lucene-based search servers already in existence... We shouldn't bloat lucene/solr even further by adding yet another. Something like this belongs as a separate project (collaborate on github with whoever else wants to build/maintain this).
        Hide
        Michael McCandless added a comment -

        Thanks Han.

        I think we should remove those hardcoded classpaths, e.g. in post.py:30?

        Good catch, I'll fix that ... that's a minimal example of how to issue commands to the server to create an index and register a few fields, from a Python client.

        And will this demo be expected to be the same as jirasearch? Will we need further configuration to get the demo webside working? For example I cannot find search.py in the sourcecodes.

        These sources are just for the server side; I didn't include the jirasearch UI/indexing sources. But I agree it would be useful to have that too, i.e. an example search app/UI that runs against this server. I'll think about how to fold it in ...

        Show
        Michael McCandless added a comment - Thanks Han. I think we should remove those hardcoded classpaths, e.g. in post.py:30? Good catch, I'll fix that ... that's a minimal example of how to issue commands to the server to create an index and register a few fields, from a Python client. And will this demo be expected to be the same as jirasearch? Will we need further configuration to get the demo webside working? For example I cannot find search.py in the sourcecodes. These sources are just for the server side; I didn't include the jirasearch UI/indexing sources. But I agree it would be useful to have that too, i.e. an example search app/UI that runs against this server. I'll think about how to fold it in ...
        Hide
        Han Jiang added a comment -

        +1, it will be great to have an 'active' demo to show the features

        I think we should remove those hardcoded classpaths, e.g. in post.py:30?

        And will this demo be expected to be the same as jirasearch? Will we need further configuration to get the demo webside working? For example I cannot find search.py in the sourcecodes.

        Show
        Han Jiang added a comment - +1, it will be great to have an 'active' demo to show the features I think we should remove those hardcoded classpaths, e.g. in post.py:30? And will this demo be expected to be the same as jirasearch? Will we need further configuration to get the demo webside working? For example I cannot find search.py in the sourcecodes.
        Hide
        Michael McCandless added a comment -

        I'm attaching the current sources (tgz archive)... they are standalone now but to add it into Lucene I think we should put it under lucene/demo or lucene/server or something.

        It uses "custom" (Python) build scripts, because I became frustrated with ant; after extracting, python3 build.py test should run the tests.

        These are just the sources for the server side of the http://jirasearch.mikemccandless.com app.

        There are many issues to fix, e.g. cut back to ant (there are some old ant build scripts there), use only one JSON parser (it uses two now), but it does support a number of basic indexing/search APIs: add/update document/s, bulk add/update documents, suggest, search/After, block joins, highlighting, live field values, snapshots, basic index statistics (for diagnostics).

        It has limited support for "plugins", but I'm tempted to remove that before committing. The only plugin it has now is Tika, to crack binary documents into text for indexing.

        Show
        Michael McCandless added a comment - I'm attaching the current sources (tgz archive)... they are standalone now but to add it into Lucene I think we should put it under lucene/demo or lucene/server or something. It uses "custom" (Python) build scripts, because I became frustrated with ant; after extracting, python3 build.py test should run the tests. These are just the sources for the server side of the http://jirasearch.mikemccandless.com app. There are many issues to fix, e.g. cut back to ant (there are some old ant build scripts there), use only one JSON parser (it uses two now), but it does support a number of basic indexing/search APIs: add/update document/s, bulk add/update documents, suggest, search/After, block joins, highlighting, live field values, snapshots, basic index statistics (for diagnostics). It has limited support for "plugins", but I'm tempted to remove that before committing. The only plugin it has now is Tika, to crack binary documents into text for indexing.

          People

          • Assignee:
            Michael McCandless
            Reporter:
            Michael McCandless
          • Votes:
            1 Vote for this issue
            Watchers:
            13 Start watching this issue

            Dates

            • Created:
              Updated:

              Development