Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-1112

Sqoop2: Date splitter might return splits omitting some boundaries

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.99.2
    • 1.99.3
    • None
    • None

    Description

      Attached test case that is using Date splitter for interval from 2004-10-20 to 2013-10-17 will create following splits on my machine (with PDT timezone):

      '2004-10-19' <= DCOL AND DCOL < '2007-10-19'
      '2007-10-19' <= DCOL AND DCOL < '2010-10-18'
      '2010-10-18' <= DCOL AND DCOL <= '2013-10-16'
      

      The last split is missing entire day 2013-10-17. I'm assuming that the issue is in the timezone conversions that we've introduced in SQOOP-1080.

      Attachments

        1. SQOOP-1112.patch
          4 kB
          Venkat Ranganathan
        2. incorrect_boudnary_test.path
          2 kB
          Jarek Jarcec Cecho

        Issue Links

          Activity

            People

              venkatnrangan Venkat Ranganathan
              jarcec Jarek Jarcec Cecho
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: