Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-3327

Mainframe FTP needs to Include "Migrated" datasets when parsing the FTP list

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 3.0.0
    • None
    • None

    Description

      Need to Include "Migrated" datasets when parsing the FTP list.

       

        • This applies to sequential datasets as well as GDG members **

       

      Identifying migrated datasets – when performing manual FTP

       

      ftp> open abc.def.ghi.jkl.mno

      Connected to abc.def.ghi.jkl.mno (11.22.33.444).

      220-TCPFTP01 Some FTP Server at abc.def.ghi.jkl.mno, 22:34:11 on 2018-01-22.

      220 Connection will close if idle for more than 10 minutes.

      Name (abc.def.ghi.jkl.mno:some_user): some_user

      331 Send password please.

      Password:

      230 some_user is logged on.  Working directory is "some_user.".

      Remote system type is MVS.

      ftp> dir

      227 Entering Passive Mode (33,44,555,66,7,8)

      125 List started OK

      Volume Unit    Referred Ext Used Recfm Lrecl BlkSz Dsorg Dsname

      Migrated                                                DEV.DATA

      Migrated                                                DUMMY.DATA

      OVR343 3390   2018/01/23  1    1  FB     132 27984  PS  EMPTY

      Migrated                                                JCL.CNTL

      OVR346 3390   2018/01/22  1    1  FB      80 27920  PS  MIXED.FB80

      Migrated                                                PLAIN.FB80

      OVR341 3390   2018/01/23  1    9  VA     125   129  PS  PRDA.SPFLOG1.LIST

      G20427 Tape                                             UNLOAD.ABCDE.ZZ9UYT.FB.TAPE

      SEM352 3390   2018/01/23  1    1  FB     150  1500  PS  USER.BRODCAST

      OVR346 3390   2018/01/23  3    3  FB      80  6160  PO  USER.ISPPROF

      250 List completed successfully.

       

      "Migrated" should be included as one of the regex pattern searches.

      Assuming space delimited, first column will be "Migrated", and the second (and final) column will contain the dataset name.

      Attachments

        1. SQOOP-3327-1.patch
          5 kB
          Chris Teoh

        Issue Links

          Activity

            People

              chris.teoh@gmail.com Chris Teoh
              chris.teoh@gmail.com Chris Teoh
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: