Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-469

Data Import RequestHandler

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.3
    • 1.3
    • update
    • None

    Description

      We need a RequestHandler Which can import data from a DB or other dataSources into the Solr index .Think of it as an advanced form of SqlUpload Plugin (SOLR-103).

      The way it works is as follows.

      • Provide a configuration file (xml) to the Handler which takes in the necessary SQL queries and mappings to a solr schema
      • It also takes in a properties file for the data source configuraution
      • Given the configuration it can also generate the solr schema.xml
      • It is registered as a RequestHandler which can take two commands do-full-import, do-delta-import
      • do-full-import - dumps all the data from the Database into the index (based on the SQL query in configuration)
      • do-delta-import - dumps all the data that has changed since last import. (We assume a modified-timestamp column in tables)
      • It provides a admin page
      • where we can schedule it to be run automatically at regular intervals
      • It shows the status of the Handler (idle, full-import, delta-import)

      Attachments

        1. xpath-stream.patch
          10 kB
          Noble Paul
        2. SOLR-469-contrib.patch
          337 kB
          Shalin Shekhar Mangar
        3. SOLR-469-contrib.patch
          349 kB
          Shalin Shekhar Mangar
        4. SOLR-469-contrib.patch
          741 kB
          Noble Paul
        5. SOLR-469-contrib.patch
          367 kB
          Shalin Shekhar Mangar
        6. SOLR-469-contrib.patch
          756 kB
          Noble Paul
        7. SOLR-469-contrib.patch
          368 kB
          Shalin Shekhar Mangar
        8. SOLR-469-contrib.patch
          379 kB
          Noble Paul
        9. SOLR-469-contrib.patch
          380 kB
          Noble Paul
        10. SOLR-469-contrib.patch
          382 kB
          Noble Paul
        11. SOLR-469-contrib.patch
          382 kB
          Noble Paul
        12. SOLR-469-contrib.patch
          385 kB
          Noble Paul
        13. SOLR-469-contrib.patch
          393 kB
          Shalin Shekhar Mangar
        14. SOLR-469.patch
          114 kB
          Shalin Shekhar Mangar
        15. SOLR-469.patch
          101 kB
          Shalin Shekhar Mangar
        16. SOLR-469.patch
          102 kB
          Shalin Shekhar Mangar
        17. SOLR-469.patch
          377 kB
          Noble Paul
        18. SOLR-469.patch
          182 kB
          Shalin Shekhar Mangar
        19. SOLR-469.patch
          182 kB
          Shalin Shekhar Mangar
        20. SOLR-469.patch
          230 kB
          Shalin Shekhar Mangar
        21. SOLR-469.patch
          324 kB
          Shalin Shekhar Mangar
        22. SOLR-469.patch
          336 kB
          Shalin Shekhar Mangar

        Issue Links

          Activity

            People

              shalin Shalin Shekhar Mangar
              noble.paul Noble Paul
              Votes:
              7 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: