Infrastructure
  1. Infrastructure
  2. INFRA-4771

Mailsearch: syntax not documented; entry field much too small

    Details

      Description

      What is the syntax for searching mail?
      How do I restrict the search to a single mailing list?
      How do I restrict the search to the subject or body?
      What conjunctions are allowed?

      The input field on the mailsearch page is far too small.

        Activity

        Hide
        #asfinfra IRC Bot added a comment -
        <pctony> Sebb, this service is running solr/lucene so you can use whatever docs they provide. The page was put up in a bit of a hurry so it didnt get a huge amount of styling tlc. If you feel you can do better, please feel free to patch it and I'll happily apply it.
        Show
        #asfinfra IRC Bot added a comment - <pctony> Sebb, this service is running solr/lucene so you can use whatever docs they provide. The page was put up in a bit of a hurry so it didnt get a huge amount of styling tlc. If you feel you can do better, please feel free to patch it and I'll happily apply it.
        Hide
        Sebb added a comment -
        Where is the page source held?

        Also, AFAICT from the Solr docs, the search options may depend on the schema - where is that defined?
        Show
        Sebb added a comment - Where is the page source held? Also, AFAICT from the Solr docs, the search options may depend on the schema - where is that defined?
        Hide
        Sebb added a comment -
        I've done some digging in the Lucene/Solr documentation, and the schema appears to be available from [1]

        This contains the following field definitions (amongst others)

           <field name="to" type="text" indexed="true" compressed="true" stored="true" multiValued="true"/>
           <field name="from" type="text" indexed="true" compressed="true" stored="true" multiValued="true"/>
           <field name="subject" type="text" compressed="true" indexed="true" stored="true" multiValued="false"/>
           <field name="listname" type="string" indexed="true" compressed="true" stored="true" multiValued="false"/>
           <field name="project" type="string" indexed="true" compressed="true" stored="true" multiValued="false"/>

        All of these would be useful as query parameters.
        However, at present AFAICT one cannot used them, because the qt=dismax parameter messes with the parsing.

        For example, "q=project:members" should in theory return all messages posted to the members list, but it does not.

        I think the search page needs to be updated to allow an optional advanced search which does not use the qt conversion.
        Either that, or the qt configuration needs to be updated somehow (but I've no idea whether the dismax parser can be configured to allow specification of list name, subject etc.).

        I can provide a patch to add advanced search to the page.
        However, I've no idea where the source for the page is kept.

        [1] https://mail-search.apache.org/solr-private/admin/file/?contentType=text/xml;charset=utf-8&file=schema.xml

        Show
        Sebb added a comment - I've done some digging in the Lucene/Solr documentation, and the schema appears to be available from [1] This contains the following field definitions (amongst others)    <field name="to" type="text" indexed="true" compressed="true" stored="true" multiValued="true"/>    <field name="from" type="text" indexed="true" compressed="true" stored="true" multiValued="true"/>    <field name="subject" type="text" compressed="true" indexed="true" stored="true" multiValued="false"/>    <field name="listname" type="string" indexed="true" compressed="true" stored="true" multiValued="false"/>    <field name="project" type="string" indexed="true" compressed="true" stored="true" multiValued="false"/> All of these would be useful as query parameters. However, at present AFAICT one cannot used them, because the qt=dismax parameter messes with the parsing. For example, "q=project:members" should in theory return all messages posted to the members list, but it does not. I think the search page needs to be updated to allow an optional advanced search which does not use the qt conversion. Either that, or the qt configuration needs to be updated somehow (but I've no idea whether the dismax parser can be configured to allow specification of list name, subject etc.). I can provide a patch to add advanced search to the page. However, I've no idea where the source for the page is kept. [1] https://mail-search.apache.org/solr-private/admin/file/?contentType=text/xml;charset=utf-8&file=schema.xml
        Hide
        Sebb added a comment -
        I've created a copy of the page, and changed the source to additionally support Advanced mode.
        The rowCount is now a variable (upped to 20), and I added some explanations of how to use advanced mode.

        I put a copy in my web area at [1].

        There are still some changes that need to be made - for example, fixing the list of projects - but there seems little point doing that without knowing how the page is generated. I had a look for the page source in SVN, but could not find it.

        [1] http://people.apache.org/~sebb/Search.htm
        Show
        Sebb added a comment - I've created a copy of the page, and changed the source to additionally support Advanced mode. The rowCount is now a variable (upped to 20), and I added some explanations of how to use advanced mode. I put a copy in my web area at [1]. There are still some changes that need to be made - for example, fixing the list of projects - but there seems little point doing that without knowing how the page is generated. I had a look for the page source in SVN, but could not find it. [1] http://people.apache.org/~sebb/Search.htm
        Hide
        Tony Stevenson added a comment -
        Transitioning to waiting for Infra
        Show
        Tony Stevenson added a comment - Transitioning to waiting for Infra
        Hide
        #asfinfra IRC Bot added a comment -
        <danielsh> Maybe you can add that content to www.a.o/dev/ somewhere, and we'll link to that place from the live page? That way it's easier for everyone to edit the page going forward.
        Show
        #asfinfra IRC Bot added a comment - <danielsh> Maybe you can add that content to www.a.o/dev/ somewhere, and we'll link to that place from the live page? That way it's easier for everyone to edit the page going forward.
        Hide
        #asfinfra IRC Bot added a comment -
        <danielsh> ping
        Show
        #asfinfra IRC Bot added a comment - <danielsh> ping
        Hide
        Sebb added a comment -
        I've added the documentation to dev/asfmailsearch.html.

        However, the search page itself on mail-search.apache.org needs to be updated in order to enable advanced mode.

        Or did you mean to implement the search form under dev/ as well?
        In which case, presumably all references to the existing form should be changed once the new form is up and running?
        Show
        Sebb added a comment - I've added the documentation to dev/asfmailsearch.html. However, the search page itself on mail-search.apache.org needs to be updated in order to enable advanced mode. Or did you mean to implement the search form under dev/ as well? In which case, presumably all references to the existing form should be changed once the new form is up and running?
        Hide
        #asfinfra IRC Bot added a comment -
        <danielsh> Patches welcome.
        Show
        #asfinfra IRC Bot added a comment - <danielsh> Patches welcome.
        Hide
        Sebb added a comment -
        As per my comment of 25/May/12 10:18

        "Where is the page source held?"
        Show
        Sebb added a comment - As per my comment of 25/May/12 10:18 "Where is the page source held?"
        Hide
        #asfinfra IRC Bot added a comment -
        <danielsh> machines/sunos/thor/x1/mail-search/*.sh
        Show
        #asfinfra IRC Bot added a comment - <danielsh> machines/sunos/thor/x1/mail-search/*.sh
        Hide
        Sebb added a comment -
        I may be missing something, but I cannot find the source for

        https://mail-search.apache.org/search/index.html

        in the specified location
        Show
        Sebb added a comment - I may be missing something, but I cannot find the source for https://mail-search.apache.org/search/index.html in the specified location
        Hide
        ASF IRC Bot added a comment -
        Comment from pctony via IRC:
        Code has been imported in r883904. You can see the source here - https://svn.apache.org/repos/infra/infrastructure/trunk/projects/mail-search/site/
        Show
        ASF IRC Bot added a comment - Comment from pctony via IRC: Code has been imported in r883904. You can see the source here - https://svn.apache.org/repos/infra/infrastructure/trunk/projects/mail-search/site/
        Hide
        #asfinfra IRC Bot added a comment -
        <pctony> I think this is done for now, if we want to update the page - commit a change and we can apply it easily enough.
        Show
        #asfinfra IRC Bot added a comment - <pctony> I think this is done for now, if we want to update the page - commit a change and we can apply it easily enough.
        Hide
        Sebb added a comment -
        Log:
        INFRA-4771 - Added advanced search; increased input field size

        Modified:
            infrastructure/trunk/projects/mail-search/site/search/index.html

        Please can this be propagated to the server?
        Show
        Sebb added a comment - Log: INFRA-4771 - Added advanced search; increased input field size Modified:     infrastructure/trunk/projects/mail-search/site/search/index.html Please can this be propagated to the server?
        Hide
        Tony Stevenson added a comment -
        pctony@thor [/x1/mail-search/htdocs ] /opt/sfw/bin/sudo /opt/subversion-current/bin/svn up
        otp-md5 461 th8276
        Password:
        U search/index.html
        Updated to revision 887664.
        Show
        Tony Stevenson added a comment - pctony@thor [/x1/mail-search/htdocs ] /opt/sfw/bin/sudo /opt/subversion-current/bin/svn up otp-md5 461 th8276 Password: U search/index.html Updated to revision 887664.

          People

          • Assignee:
            Tony Stevenson
            Reporter:
            Sebb
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development