Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-1138

incremental lastmodified should re-use output directory

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.4
    • 1.4.5
    • None
    • None

    Description

      When using --incremental lastmodified option in sqoop command line "the second job will take both the old and new data and will merge them together into the final output, preserving only the last updated value for each row."

      However, when I try to run incremental lastmodified twice, the second time I get "FileAlreadyExistsException: Output directory already exists".

      The incremental lastmodified should read from this directory to get the data from the last run and should not throw an exception.

      Attachments

        1. SQOOP-1138.0.patch
          4 kB
          Abraham Elmahrek
        2. SQOOP-1138.1.patch
          20 kB
          Abraham Elmahrek
        3. SQOOP-1138.2.patch
          19 kB
          Abraham Elmahrek
        4. SQOOP-1138.4.patch
          19 kB
          Abraham Elmahrek
        5. SQOOP-1138.5.patch
          20 kB
          Abraham Elmahrek
        6. SQOOP-1138.6.patch
          20 kB
          Abraham Elmahrek

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. SQOOP-1340 Sqoop incremental import with target-dir from MySQL

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link Review Board

          Activity

            People

              abec Abraham Elmahrek
              jmspaggi Jean-Marc Spaggiari
              Votes:
              5 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: