Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-1605

Sqoop2: Misc From/to cleanups

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.99.4
    • 1.99.4
    • None
    • None

    Description

       //Job Manager
           if (lastSubmission != null && lastSubmission.getStatus().isRunning()) {
              throw new SqoopException(DriverError.DRIVER_0002, "Job with id " + jobId);
            }
            // TODO(Abe): Call multiple destroyers.
            // TODO(jarcec): We might need to catch all exceptions here to ensure
            // that Destroyer will be executed in all cases.
            // NOTE: the following is a blocking call
            boolean success = submissionEngine.submit(jobRequest);
            if (!success) {
          
      // TestJdbcRepository
        upgraderOrder.verifyNoMoreInteractions();
          validatorOrder.verify(validatorMock, times(2)).validateConfigForLink(anyObject());
          // @TODO(Abe): Re-enable job validation?
          validatorOrder.verify(validatorMock, times(0)).validateConfigForJob(anyObject());
          validatorOrder.verifyNoMoreInteractions();
        
      
      //JobRequestHandler
      
            // Add associated resources into the bean
            // @TODO(Abe): From/To.
            for( MJob job : jobs) {
              long connectorId = job.getConnectorId(Direction.FROM);
              if(!bean.hasConnectorConfigBundle(connectorId)) {
                bean.addConnectorConfigBundle(connectorId,
         
      
      
      // some test code ( jarcec might fix this in his validator code)
         
       // @TODO(Abe): From/To.
         ResourceBundle fromConfigBundle = client.getConnectorConfigBundle(
             job.getConnectorId(Direction.FROM));
       upgraderOrder.verifyNoMoreInteractions();
         validatorOrder.verify(validatorMock, times(2)).validateConfigForLink(anyObject());
      
         // @TODO(Abe): Re-enable job validation?
         validatorOrder.verify(validatorMock, times(0)).validateConfigForJob(anyObject());
      
      
      //Mapreduce Submission Engine
       MRConfigurationUtils.setConnectorJobConfig(Direction.FROM, job, request.getJobConfig(Direction.FROM));
            MRConfigurationUtils.setConnectorJobConfig(Direction.TO, job, request.getJobConfig(Direction.TO));
      
            MRConfigurationUtils.setDriverConfig(job, request.getDriverConfig());
            // @TODO(Abe): Persist TO schema.
            MRConfigurationUtils.setConnectorSchema(Direction.FROM, job, request.getSummary().getFromSchema());
            MRConfigurationUtils.setConnectorSchema(Direction.TO, job, request.getSummary().getToSchema());
      
      
      

      Attachments

        1. SQOOP-1605.0.patch
          6 kB
          Abraham Elmahrek

        Issue Links

          Activity

            People

              abec Abraham Elmahrek
              vybs Veena Basavaraj
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: