Uploaded image for project: 'Jackrabbit Oak'
  1. Jackrabbit Oak
  2. OAK-9004

Multitenant index name strategy with reindex support

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.30.0
    • indexing
    • None

    Description

      Index names in elastic follow the pattern <name>-<reindex-count>

      This has to be changed in order to support multi-tenancy.

      We need to pass a parameter with the customer ID so we can create indexes like <customer>.<name>-<reindex-count>.  ES indexes cannot be longer than 255 bytes and must comply with the following criteria https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-create-index.html#indices-create-api-path-params

       

      We need also to decide what to do on re-index. The simpler strategy would be to:

      • create the new index
      • move writes and reads to the new index
      • delete old index

      A more sophisticated strategy could:

      • create the new index
      • move writes to the new index
      • reads will continue to use the old index until the new one catches up
      • when the new one is in sync, move reads to the new index & delete the old one

      Both strategies can be implemented using Aliases in Elasticsearch to avoid race conditions. To implement the second solution we need something that tells us when the new index has caught up with the initial load.

      Attachments

        1. OAK-9004_1.patch
          18 kB
          Amrit Verma
        2. OAK-9004_2.patch
          18 kB
          Amrit Verma
        3. OAK-9004.patch
          22 kB
          Amrit Verma

        Issue Links

          Activity

            People

              Unassigned Unassigned
              amrverma Amrit Verma
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: