Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-3345

TestWindowFrame fails to properly check cases involving multiple batches

    XMLWordPrintableJSON

Details

    Description

      as part of adding unit tests to TestWindowFrame, I added a debug option to MSorter to force the batches passed downstream to be of a specific size. This was supposed to help test edge cases involving multiple data batches while controlling precisely when a partition and/or window frame ends in a batch.

      Turns out the change to MSorter was incomplete and all cases end up processing one single big batch of data.

      The purpose of this JIRA issue is to fix this, add some check to detect when the batches are no longer split correctly and make sure all unit tests are passing.

      Attachments

        1. DRILL-3345.1.patch.txt
          6 kB
          Abdel Hakim Deneche
        2. DRILL-3345.2.patch.txt
          6 kB
          Abdel Hakim Deneche

        Issue Links

          Activity

            People

              adeneche Abdel Hakim Deneche
              adeneche Abdel Hakim Deneche
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: