Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-13956

Solr 4 to Solr7 migration DIH behavior change

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Invalid
    • Affects Version/s: 7.5
    • Fix Version/s: None
    • Labels:
      None

      Description

      I migrated from Solr 4 to 7.5 and I see an issue with the way DIH is working. I use `JdbcDataSource` and here the config file is attached

      1) I started seeing OutOfMemory issue since MySQL JDBC driver has that issue of not respecting `batchSize` (though Solr4 didn't show this behavior). So, I added `batchSize=-1` for that

      2) After adding that I'm running into ResultSet closed exception as shown below while fetching the child entity

       
      getNext() failed for query ' SELECT REVIEW AS REVIEWS FROM SOLR_SITTER_SERVICE_PROFILE_REVIEWS WHERE SERVICE_PROFILE_ID = '17' ; ':org.apache.solr.handler.dataimport.DataImportHandlerException: java.sql.SQLException: Operation not allowed after ResultSet closed
      at org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:61)
      at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.hasnext(JdbcDataSource.java:464)
      at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator$1.hasNext(JdbcDataSource.java:377)
      at org.apache.solr.handler.dataimport.EntityProcessorBase.getNext(EntityProcessorBase.java:133)
      at org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityProcessor.java:75)
      at org.apache.solr.handler.dataimport.EntityProcessorWrapper.nextRow(EntityProcessorWrapper.java:267)
      at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:476)
      at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:517)
      at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:415)
      at org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:33)
      at org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:233)
      at org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:424)
      at org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:483)
      at org.apache.solr.handler.dataimport.DataImporter.lambda$runAsync$0(DataImporter.java:466)
      at java.lang.Thread.run(Thread.java:748)
      Caused by: java.sql.SQLException: Operation not allowed after ResultSet closed
      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1075)
      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:989)
      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:984)
      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:929)
      at com.mysql.jdbc.ResultSetImpl.checkClosed(ResultSetImpl.java:794)
      at com.mysql.jdbc.ResultSetImpl.next(ResultSetImpl.java:7145)
      at com.mysql.jdbc.StatementImpl.getMoreResults(StatementImpl.java:2078)
      at com.mysql.jdbc.StatementImpl.getMoreResults(StatementImpl.java:2062)
      at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.hasnext(JdbcDataSource.java:458)
      ... 13 more
       

      Is this a known issue? How do I fix this, any help is greatly appreciated.

      I searched the user/developer group and didn't find an answer. 

        Attachments

        1. serviceprofile-data-import.xml
          23 kB
          shashank bellary

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              sbellary shashank bellary
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: