Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-1168 Sqoop2: Delta Fetch/ Merge ( formerly called Incremental Import )
  3. SQOOP-1801

Delta Fetch Merge Config API : Validations for the Delta Fetch/Merge Configs

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 1.99.5
    • Component/s: None
    • Labels:
      None

      Description

      The configs will mainly have the operators, columns and values

      1. Required/ Optional validation
      operators (Required, or we default to > ) , column (Required) and values ( optional) and the las-value in the from config will be used

      2. Enum of supported operators and its semantics and check if the operator is valid
      Supported operators ( < , >, LIKE, IN BETWEEN...) to begin with

      3. Validate if the column exists in the data source.

      4. Validate that the corresponding connectors support the incremental.

      Few more are possible depending on how much feedback we want to give in the early stages...

        Attachments

          Activity

            People

            • Assignee:
              vybs Veena Basavaraj
              Reporter:
              vybs Veena Basavaraj
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: