Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-1086 Running multiple incremental sqoop jobs in parallel resets the first sqoop job's --last-value
  3. SQOOP-2988

Update Sqoop1 Docs (warning about parallel jobs and "local" Sqoop1 Metastore)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      An update of the Sqoop1 Documentation is needed. Warning should be added about that in case of parallel incremental workloads using the "local" metastore can result in unexpected behavior such as INSERT/UDATE related information (e.g. incremental.last.value) doesn't get updated properly. A recommendation should also be added to use shared metastore instead. More details can be found in the parent issue.

      Attachments

        Activity

          People

            markuskemper@me.com Markus Kemper
            BoglarkaEgyed Boglarka Egyed
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: