Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-2572

MODEL_004:Usage of unsupported data type when using DateTime type

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.99.7
    • 1.99.7
    • None
    • None

    Description

      I've tried to incorporate the newly introduced DateTime type from SQOOP-2559 in my patch for incremental import in HDFS connector SQOOP-2525. It seems that we missed one place where each type needs to be defined:

      81469 [main] INFO  org.apache.sqoop.test.testcases.ConnectorTestCase  - Submission finished: MSubmission [jobId=1, status=FAILURE_ON_SUBMIT, externalId=null, progress=-1.0, counters=null, externalLink=null, error=JobSubmissionError [errorSummary=org.apache.sqoop.common.SqoopException: MODEL_004:Usage of unsupported data type - Unsupported type org.joda.time.DateTime for input incremental.lastImportedDate, errorDetails=org.apache.sqoop.common.SqoopException: MODEL_004:Usage of unsupported data type - Unsupported type org.joda.time.DateTime for input incremental.lastImportedDate	at org.apache.sqoop.model.ConfigUtils.toJson(ConfigUtils.java:458)	at org.apache.sqoop.job.mr.MRConfigurationUtils.setConnectorJobConfig(MRConfigurationUtils.java:114)	at org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.submit(MapreduceSubmissionEngine.java:212)	at org.apache.sqoop.driver.JobManager.start(JobManager.java:295)	at org.apache.sqoop.handler.JobRequestHandler.startJob(JobRequestHandler.java:388)	at org.apache.sqoop.handler.JobRequestHandler.handleEvent(JobRequestHandler.java:117)	at org.apache.sqoop.server.v1.JobServlet.handlePutRequest(JobServlet.java:97)	at org.apache.sqoop.server.SqoopProtocolServlet.doPut(SqoopProtocolServlet.java:81)	at javax.servlet.http.HttpServlet.service(HttpServlet.java:646)	at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:572)	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:269)	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:542)	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)	at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:615)	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)	at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:861)	at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:606)	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)	at java.lang.Thread.run(Thread.java:745)], 
      

      Attachments

        1. SQOOP-2572.1.patch
          4 kB
          Dian Fu

        Issue Links

          Activity

            People

              dian.fu Dian Fu
              jarcec Jarek Jarcec Cecho
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: