Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-469

Data Import RequestHandler



    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.3
    • Fix Version/s: 1.3
    • Component/s: update
    • Labels:


      We need a RequestHandler Which can import data from a DB or other dataSources into the Solr index .Think of it as an advanced form of SqlUpload Plugin (SOLR-103).

      The way it works is as follows.

      • Provide a configuration file (xml) to the Handler which takes in the necessary SQL queries and mappings to a solr schema
      • It also takes in a properties file for the data source configuraution
      • Given the configuration it can also generate the solr schema.xml
      • It is registered as a RequestHandler which can take two commands do-full-import, do-delta-import
      • do-full-import - dumps all the data from the Database into the index (based on the SQL query in configuration)
      • do-delta-import - dumps all the data that has changed since last import. (We assume a modified-timestamp column in tables)
      • It provides a admin page
      • where we can schedule it to be run automatically at regular intervals
      • It shows the status of the Handler (idle, full-import, delta-import)


        1. SOLR-469.patch
          336 kB
          Shalin Shekhar Mangar
        2. SOLR-469.patch
          324 kB
          Shalin Shekhar Mangar
        3. SOLR-469.patch
          230 kB
          Shalin Shekhar Mangar
        4. SOLR-469.patch
          182 kB
          Shalin Shekhar Mangar
        5. SOLR-469.patch
          182 kB
          Shalin Shekhar Mangar
        6. SOLR-469.patch
          377 kB
          Noble Paul
        7. SOLR-469.patch
          102 kB
          Shalin Shekhar Mangar
        8. SOLR-469.patch
          101 kB
          Shalin Shekhar Mangar
        9. SOLR-469.patch
          114 kB
          Shalin Shekhar Mangar
        10. SOLR-469-contrib.patch
          393 kB
          Shalin Shekhar Mangar
        11. SOLR-469-contrib.patch
          385 kB
          Noble Paul
        12. SOLR-469-contrib.patch
          382 kB
          Noble Paul
        13. SOLR-469-contrib.patch
          382 kB
          Noble Paul
        14. SOLR-469-contrib.patch
          380 kB
          Noble Paul
        15. SOLR-469-contrib.patch
          379 kB
          Noble Paul
        16. SOLR-469-contrib.patch
          368 kB
          Shalin Shekhar Mangar
        17. SOLR-469-contrib.patch
          756 kB
          Noble Paul
        18. SOLR-469-contrib.patch
          367 kB
          Shalin Shekhar Mangar
        19. SOLR-469-contrib.patch
          741 kB
          Noble Paul
        20. SOLR-469-contrib.patch
          349 kB
          Shalin Shekhar Mangar
        21. SOLR-469-contrib.patch
          337 kB
          Shalin Shekhar Mangar
        22. xpath-stream.patch
          10 kB
          Noble Paul

          Issue Links



              • Assignee:
                shalin Shalin Shekhar Mangar
                noble.paul Noble Paul
              • Votes:
                7 Vote for this issue
                13 Start watching this issue


                • Created: