Solr
  1. Solr
  2. SOLR-4388

Admin UI - SolrCloud - expose Collections API

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 4.1
    • Fix Version/s: 5.4, 6.0
    • Component/s: web gui
    • Labels:
      None

      Description

      The CoreAdmin API is fairly well represented in the UI. When SolrCloud is enabled, the Collections API for SolrCloud needs similar treatment.

      1. collections-1.png
        44 kB
        Upayavira
      2. collections-2.png
        82 kB
        Upayavira
      3. collections-3.png
        34 kB
        Upayavira
      4. collections-4.png
        32 kB
        Upayavira
      5. SOLR-4388.patch
        35 kB
        Upayavira
      6. SOLR-4388.patch
        31 kB
        Upayavira
      7. SOLR-4388-2.patch
        2 kB
        Upayavira

        Issue Links

          Activity

          Hide
          Shawn Heisey added a comment -

          The comment I just placed on SOLR-4316 should have gone here:

          The first thing from the collections API that I would like to see is interactive CREATE functionality. The second is DELETE functionality, with the right amount of "are you sure you want to do this?" prompting.

          This comment is part of an effort to close old issues that I have reported. Search tag: elyograg2013springclean

          Show
          Shawn Heisey added a comment - The comment I just placed on SOLR-4316 should have gone here: The first thing from the collections API that I would like to see is interactive CREATE functionality. The second is DELETE functionality, with the right amount of "are you sure you want to do this?" prompting. This comment is part of an effort to close old issues that I have reported. Search tag: elyograg2013springclean
          Hide
          Steve Rowe added a comment -

          Bulk move 4.4 issues to 4.5 and 5.0

          Show
          Steve Rowe added a comment - Bulk move 4.4 issues to 4.5 and 5.0
          Hide
          Uwe Schindler added a comment -

          Move issue to Solr 4.9.

          Show
          Uwe Schindler added a comment - Move issue to Solr 4.9.
          Hide
          Upayavira added a comment -

          This is the most obvious next step once the AngularJS Admin UI is completed, although, I wonder whether we need the collections API to work in non-cloud mode, and then build a UI around that.

          (there are two more panes to do on the AngularJS UI, both of which I am half way through)

          Show
          Upayavira added a comment - This is the most obvious next step once the AngularJS Admin UI is completed, although, I wonder whether we need the collections API to work in non-cloud mode, and then build a UI around that. (there are two more panes to do on the AngularJS UI, both of which I am half way through)
          Hide
          Varun Thacker added a comment -

          Maybe it should expose it as one? Like how the start script does with the 'create' option. If it's standalone Solr then we make core admin calls. If it's SolrCloud then Collection API calls will be made.

          As discussed here http://markmail.org/thread/i4ynycr5fsqc275j we want to stop exposing the core admin apis. So if we do it we'll be masking it from the UI and when that is implemented make all calls to the collection api.

          Any opinions on whether this is a good idea?

          Show
          Varun Thacker added a comment - Maybe it should expose it as one? Like how the start script does with the 'create' option. If it's standalone Solr then we make core admin calls. If it's SolrCloud then Collection API calls will be made. As discussed here http://markmail.org/thread/i4ynycr5fsqc275j we want to stop exposing the core admin apis. So if we do it we'll be masking it from the UI and when that is implemented make all calls to the collection api. Any opinions on whether this is a good idea?
          Hide
          Upayavira added a comment -

          I could certainly do it all within the UI, but that just feels wrong, and at best a nasty workaround.

          We should make a UI for the collections API, but, we should do that backed by a correct API, and we should deprecated the core admin tab of the UI too.

          Show
          Upayavira added a comment - I could certainly do it all within the UI, but that just feels wrong, and at best a nasty workaround. We should make a UI for the collections API, but, we should do that backed by a correct API, and we should deprecated the core admin tab of the UI too.
          Hide
          Erick Erickson added a comment -

          Hmmmm. Is the proposal here to use the Collections API even in the non-SolrCloud case to do what the core admin API does (or equivalent) now? We just need to be sure that the non-Cloud mode is supported somehow.

          Show
          Erick Erickson added a comment - Hmmmm. Is the proposal here to use the Collections API even in the non-SolrCloud case to do what the core admin API does (or equivalent) now? We just need to be sure that the non-Cloud mode is supported somehow.
          Hide
          Upayavira added a comment -

          There has been a proposal, elsewhere, that the collections API should support non-cloud mode.

          This ticket should depend upon that work. We could replace the Core Admin tab with a collections admin tab which works in both cloud and non-cloud modes.

          Show
          Upayavira added a comment - There has been a proposal, elsewhere, that the collections API should support non-cloud mode. This ticket should depend upon that work. We could replace the Core Admin tab with a collections admin tab which works in both cloud and non-cloud modes.
          Hide
          Shawn Heisey added a comment -

          This ticket should depend upon that work.

          I disagree, but not enough for a formal -1 vote. These admin UI improvements are pretty important in my opinion. I think we should expose the Collections API for SolrCloud collections and keep using the CoreAdmin API for cores until the non-cloud Collections API is done. If the new API is done right, it will be substantially similar to the existing CoreAdmin API, so the admin UI migration should be very easy.

          The CoreAdmin API is not going to disappear, at least not in any 5.x version. It just won't be publicly documented any more, and users will be encouraged to switch to the Collections API. Some deprecations in SolrJ are likely.

          Show
          Shawn Heisey added a comment - This ticket should depend upon that work. I disagree, but not enough for a formal -1 vote. These admin UI improvements are pretty important in my opinion. I think we should expose the Collections API for SolrCloud collections and keep using the CoreAdmin API for cores until the non-cloud Collections API is done. If the new API is done right, it will be substantially similar to the existing CoreAdmin API, so the admin UI migration should be very easy. The CoreAdmin API is not going to disappear, at least not in any 5.x version. It just won't be publicly documented any more, and users will be encouraged to switch to the Collections API. Some deprecations in SolrJ are likely.
          Hide
          Upayavira added a comment -

          First pass at a collections API tab that replaces the core admin tab when in cloud mode.

          Supports add/delete collection, and shows details of the collection and its shards/replicas. Adding "add/delete replica" and "add/remove alias" is pretty easy.

          Show
          Upayavira added a comment - First pass at a collections API tab that replaces the core admin tab when in cloud mode. Supports add/delete collection, and shows details of the collection and its shards/replicas. Adding "add/delete replica" and "add/remove alias" is pretty easy.
          Hide
          Upayavira added a comment -

          Just need to do add/delete replica, then first pass at this ticket will be complete.

          Show
          Upayavira added a comment - Just need to do add/delete replica, then first pass at this ticket will be complete.
          Hide
          Upayavira added a comment -

          This is the first version of the collections UI that is "ready" enough.

          It likely has issues, but given it is new code, I plan to commit it soon.

          Please folks, play with it! Follow the link to the new UI when in cloud mode, and try out the collections tab, and feed back what you like/don't like.

          Show
          Upayavira added a comment - This is the first version of the collections UI that is "ready" enough. It likely has issues, but given it is new code, I plan to commit it soon. Please folks, play with it! Follow the link to the new UI when in cloud mode, and try out the collections tab, and feed back what you like/don't like.
          Hide
          ASF subversion and git services added a comment -

          Commit 1707245 from Upayavira in branch 'dev/trunk'
          [ https://svn.apache.org/r1707245 ]

          SOLR-4388 Add a Collections UI for SolrCloud

          Show
          ASF subversion and git services added a comment - Commit 1707245 from Upayavira in branch 'dev/trunk' [ https://svn.apache.org/r1707245 ] SOLR-4388 Add a Collections UI for SolrCloud
          Hide
          ASF subversion and git services added a comment -

          Commit 1707247 from Upayavira in branch 'dev/branches/branch_5x'
          [ https://svn.apache.org/r1707247 ]

          SOLR-4388 Add a Collections UI for SolrCloud

          Show
          ASF subversion and git services added a comment - Commit 1707247 from Upayavira in branch 'dev/branches/branch_5x' [ https://svn.apache.org/r1707247 ] SOLR-4388 Add a Collections UI for SolrCloud
          Hide
          Varun Thacker added a comment -

          Hi Upayavira,

          Is it plugged in the the new UI? I didn't find it on http://localhost:8983/solr/admin.html#/ . That is the correct URL right?

          In server/solr-webapp/webapp/js/angular/controllers/ I do see a collections.js file though.

          Show
          Varun Thacker added a comment - Hi Upayavira, Is it plugged in the the new UI? I didn't find it on http://localhost:8983/solr/admin.html#/ . That is the correct URL right? In server/solr-webapp/webapp/js/angular/controllers/ I do see a collections.js file though.
          Hide
          Upayavira added a comment -

          Varun Thacker You should see a link at the top right pointing to the "new UI". Click that. Then you'll see it, if you are in cloud mode.

          Show
          Upayavira added a comment - Varun Thacker You should see a link at the top right pointing to the "new UI". Click that. Then you'll see it, if you are in cloud mode.
          Hide
          ASF subversion and git services added a comment -

          Commit 1707269 from Upayavira in branch 'dev/trunk'
          [ https://svn.apache.org/r1707269 ]

          SOLR-4388 SOLR-7858 SOLR-7666 update CHANGES.txt

          Show
          ASF subversion and git services added a comment - Commit 1707269 from Upayavira in branch 'dev/trunk' [ https://svn.apache.org/r1707269 ] SOLR-4388 SOLR-7858 SOLR-7666 update CHANGES.txt
          Hide
          ASF subversion and git services added a comment -

          Commit 1707270 from Upayavira in branch 'dev/branches/branch_5x'
          [ https://svn.apache.org/r1707270 ]

          SOLR-4388 SOLR-7858 SOLR-7666 update CHANGES.txt

          Show
          ASF subversion and git services added a comment - Commit 1707270 from Upayavira in branch 'dev/branches/branch_5x' [ https://svn.apache.org/r1707270 ] SOLR-4388 SOLR-7858 SOLR-7666 update CHANGES.txt
          Hide
          Varun Thacker added a comment -

          Oh I missed that toggle. I was under the impression that going to http://localhost:8983/solr/admin.html#/ would directly take you to the new ui. Looks like that changed with SOLR-7858 .

          Thanks for adding this UI screen!

          Here are my first thoughts:

          • Auto-add replicas shows a tick mark while my collection has it set to false.
          • I select a collection, then when I explicitly click on Overview under it , it takes me to the main Overview tab.
          • Schema browser tab: We can't load term info against a collection. The field definition is not present as well . Maybe we should make the terms handler distributed as well?
          • I get a "healthcheck not configured" error when I first select a core.
          • Ping request handler works on distributed mode as well after SOLR-7746 so maybe we put it in the collections tab?

          I'll try taking a more in-depth look at it soon.

          Show
          Varun Thacker added a comment - Oh I missed that toggle. I was under the impression that going to http://localhost:8983/solr/admin.html#/ would directly take you to the new ui. Looks like that changed with SOLR-7858 . Thanks for adding this UI screen! Here are my first thoughts: Auto-add replicas shows a tick mark while my collection has it set to false. I select a collection, then when I explicitly click on Overview under it , it takes me to the main Overview tab. Schema browser tab: We can't load term info against a collection. The field definition is not present as well . Maybe we should make the terms handler distributed as well? I get a "healthcheck not configured" error when I first select a core. Ping request handler works on distributed mode as well after SOLR-7746 so maybe we put it in the collections tab? I'll try taking a more in-depth look at it soon.
          Hide
          ASF subversion and git services added a comment -

          Commit 1707274 from Upayavira in branch 'dev/trunk'
          [ https://svn.apache.org/r1707274 ]

          SOLR-4388 Fix overview link and autoAddReplicas

          Show
          ASF subversion and git services added a comment - Commit 1707274 from Upayavira in branch 'dev/trunk' [ https://svn.apache.org/r1707274 ] SOLR-4388 Fix overview link and autoAddReplicas
          Hide
          ASF subversion and git services added a comment -

          Commit 1707275 from Upayavira in branch 'dev/branches/branch_5x'
          [ https://svn.apache.org/r1707275 ]

          SOLR-4388 Fix overview link and autoAddReplicas

          Show
          ASF subversion and git services added a comment - Commit 1707275 from Upayavira in branch 'dev/branches/branch_5x' [ https://svn.apache.org/r1707275 ] SOLR-4388 Fix overview link and autoAddReplicas
          Hide
          Upayavira added a comment -

          The URL for the new UI is http://localhost:8983/solr/index.html. The one you referred to is direct to the old UI

          • AutoaddReplicas - thx, I've fixed that
          • I spotted the 'overview' link issue myself just now and fixed it
          • Schema browser: terms only come from a core. A distributed terms handler would be great
          • healthcheck: I knew that was around but couldn't reproduce it. Thanks, I'll fix it
          • ping: what does it do in distributed mode?
          Show
          Upayavira added a comment - The URL for the new UI is http://localhost:8983/solr/index.html . The one you referred to is direct to the old UI AutoaddReplicas - thx, I've fixed that I spotted the 'overview' link issue myself just now and fixed it Schema browser: terms only come from a core. A distributed terms handler would be great healthcheck: I knew that was around but couldn't reproduce it. Thanks, I'll fix it ping: what does it do in distributed mode?
          Hide
          ASF subversion and git services added a comment -

          Commit 1707383 from Michael McCandless in branch 'dev/branches/branch_5x'
          [ https://svn.apache.org/r1707383 ]

          SOLR-4388: fix the build (missing svn:eol-style props)

          Show
          ASF subversion and git services added a comment - Commit 1707383 from Michael McCandless in branch 'dev/branches/branch_5x' [ https://svn.apache.org/r1707383 ] SOLR-4388 : fix the build (missing svn:eol-style props)
          Hide
          ASF subversion and git services added a comment -

          Commit 1707384 from Michael McCandless in branch 'dev/trunk'
          [ https://svn.apache.org/r1707384 ]

          SOLR-4388: fix the build (missing svn:eol-style props)

          Show
          ASF subversion and git services added a comment - Commit 1707384 from Michael McCandless in branch 'dev/trunk' [ https://svn.apache.org/r1707384 ] SOLR-4388 : fix the build (missing svn:eol-style props)
          Hide
          Upayavira added a comment -

          patch that:

          • Make chevron change as list is opened/closed
          • Makes 'new_collection' a placeholder not a default value
            (i accidentally created a stuffnew_collection collection - not good)
          Show
          Upayavira added a comment - patch that: Make chevron change as list is opened/closed Makes 'new_collection' a placeholder not a default value (i accidentally created a stuffnew_collection collection - not good)
          Hide
          Upayavira added a comment -

          these changes were committed as a part of SOLR-7666

          Show
          Upayavira added a comment - these changes were committed as a part of SOLR-7666

            People

            • Assignee:
              Upayavira
              Reporter:
              Shawn Heisey
            • Votes:
              2 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development