Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-3277

Sqoop from Oracle RDB database is failing with exception SQLException in nextKeyValue

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Not A Bug
    • 1.4.6
    • None
    • test
    • None

    Description

      Sqoop from Oracle RDB database is failing with exception SQLException in nextKeyValue. Below is the error log

      17/12/22 11:20:35 INFO Configuration.deprecation: mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
      17/12/22 11:20:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1512111796128_818880
      17/12/22 11:20:35 INFO security.ExternalTokenManagerFactory: Initialized external token manager class - com.mapr.hadoop.yarn.security.MapRTicketManager
      17/12/22 11:20:35 INFO impl.YarnClientImpl: Submitted application application_1512111796128_818880
      17/12/22 11:20:35 INFO mapreduce.Job: The url to track the job: https://dbsld0069.uhc.com:8090/proxy/application_1512111796128_818880/
      17/12/22 11:20:35 INFO mapreduce.Job: Running job: job_1512111796128_818880
      17/12/22 11:20:43 INFO mapreduce.Job: Job job_1512111796128_818880 running in uber mode : false
      17/12/22 11:20:43 INFO mapreduce.Job:  map 0% reduce 0%
      17/12/22 15:13:18 INFO mapreduce.Job: Task Id : attempt_1512111796128_818880_m_000000_0, Status : FAILED
      Error: java.io.IOException: SQLException in nextKeyValue
      at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277)
      at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:565)
      at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
      at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
      at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
      at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
      at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:346)
      at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:422)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
      at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
      Caused by: java.sql.SQLRecoverableException: IO Error: End of TNS data channel
      at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1128)
      at oracle.jdbc.driver.OracleResultSetImpl.close_or_fetch_from_next(OracleResultSetImpl.java:373)
      at oracle.jdbc.driver.OracleResultSetImpl.next(OracleResultSetImpl.java:277)
      at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:237)
      ... 12 more

      Caused by: oracle.net.ns.NetException: End of TNS data channel
      at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:308)
      at oracle.net.ns.NetInputStream.read(NetInputStream.java:260)
      at oracle.net.ns.NetInputStream.read(NetInputStream.java:185)
      at oracle.net.ns.NetInputStream.read(NetInputStream.java:102)
      at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:124)
      at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:80)
      at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1137)
      at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:290)
      at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192)
      at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
      at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
      at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1119)
      ... 15 more

       

       

      --> Database from which we are sqooping data is Oracle RDB. We have tried out different work arounds.

      1. Mapping all the columns to String while sqooping
      2. Handling the Date/timestamp fields i.e, mapping 0000-00-00 value as null while sqooping.

      This work around successfully sqooped most of the tables but still we are facing the exception for few tables.

      Does any one came across this issue whie sqooping? Could you please provide any suggestions/help on how to resolve this

      Attachments

        Activity

          People

            maugli Attila Szabo
            chaitanyakande Chaitanya Krishna Kande
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: