Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Duplicate
    • Affects Version/s: 1.3
    • Fix Version/s: None
    • Component/s: update
    • Labels:
      None

      Description

      Solr needs an easy way to upload lots of files directly from SQL.

      See also: SOLR-66 (CSV uploader)

      1. SOLR-103-SQLUpdateRequestHandler.patch
        12 kB
        Ryan McKinley
      2. SOLR-103-SQLUpdateRequestHandler.patch
        11 kB
        Ryan McKinley
      3. SOLR-103-SQLUpdateRequestHandler.patch
        11 kB
        Ryan McKinley

        Issue Links

          Activity

          Hide
          Ryan McKinley added a comment -

          A draft SQL updater is included in SOLR-104

          C:\workspace\solr\src\java\org\apache\solr\handler\add\SQLUpdateHandler.java

          There is also a unit test. I have it running successfully with eclipse, but not with ant yet. You will need to manually add your sql driver (ie: mysql-connector-java-3.1.13-bin.jar) to the classpath manually until we decide what to do with it.

          Show
          Ryan McKinley added a comment - A draft SQL updater is included in SOLR-104 C:\workspace\solr\src\java\org\apache\solr\handler\add\SQLUpdateHandler.java There is also a unit test. I have it running successfully with eclipse, but not with ant yet. You will need to manually add your sql driver (ie: mysql-connector-java-3.1.13-bin.jar) to the classpath manually until we decide what to do with it.
          Show
          Ryan McKinley added a comment - check: http://svn.lapnap.net/solr/handler-draft/solr/src/java/org/apache/solr/handler/add/SQLUpdateHandler.java http://svn.lapnap.net/solr/handler-draft/solr/src/test/org/apache/solr/handler/SQLUpdateTest.java If you run the example from SOLR-104 , mess with the parameters on: http://localhost:8983/solr/up.html
          Hide
          Matthew Runo added a comment -

          It would be nice if we could provide a JDBC connection and input a SQL query which would be ran on a configurable timeline.

          Show
          Matthew Runo added a comment - It would be nice if we could provide a JDBC connection and input a SQL query which would be ran on a configurable timeline.
          Hide
          Ryan McKinley added a comment -

          yes, it would be nice to support some similar functions as http://www.dbsight.net/

          Show
          Ryan McKinley added a comment - yes, it would be nice to support some similar functions as http://www.dbsight.net/
          Hide
          Ryan McKinley added a comment -

          compiles with trunk + SOLR-193 + SOLR-139

          Far from complete, but works for my immediate needs

          Show
          Ryan McKinley added a comment - compiles with trunk + SOLR-193 + SOLR-139 Far from complete, but works for my immediate needs
          Hide
          Koji Sekiguchi added a comment -

          We'd like to use it. Can you revise the patch to be adapted into the current trunk, please?

          Show
          Koji Sekiguchi added a comment - We'd like to use it. Can you revise the patch to be adapted into the current trunk, please?
          Hide
          Ryan McKinley added a comment -

          updated to work with trunk...

          (i haven't used this in a while and the tests are not very good, so it may have some hickups)

          Show
          Ryan McKinley added a comment - updated to work with trunk... (i haven't used this in a while and the tests are not very good, so it may have some hickups)
          Hide
          Koji Sekiguchi added a comment -

          It worked well for me. Thank you.

          Show
          Koji Sekiguchi added a comment - It worked well for me. Thank you.
          Hide
          Grant Ingersoll added a comment -

          What do you make of adding a test dependency for an embeddable database, such as Derby or HSQL such that the test doesn't require MySQL?

          Show
          Grant Ingersoll added a comment - What do you make of adding a test dependency for an embeddable database, such as Derby or HSQL such that the test doesn't require MySQL?
          Hide
          Hoss Man added a comment -

          it's been a while since i looked at such things, but i'm pretty sure there's a really good mock jdbc driver out there which should work well for tests. (so we don't have to include an entire embeddable DB in the source distribution ... assuming the mock driver is smaller then a real DB)

          Show
          Hoss Man added a comment - it's been a while since i looked at such things, but i'm pretty sure there's a really good mock jdbc driver out there which should work well for tests. (so we don't have to include an entire embeddable DB in the source distribution ... assuming the mock driver is smaller then a real DB)
          Hide
          Grant Ingersoll added a comment -

          Can we close this out in light of the DataImportHandler?

          Show
          Grant Ingersoll added a comment - Can we close this out in light of the DataImportHandler?
          Hide
          Ryan McKinley added a comment -

          the DataImportHandler should take care of this...

          Show
          Ryan McKinley added a comment - the DataImportHandler should take care of this...

            People

            • Assignee:
              Unassigned
              Reporter:
              Ryan McKinley
            • Votes:
              7 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development