Uploaded image for project: 'Calcite'
  1. Calcite
  2. CALCITE-1429

Druid adapter must send "fromNext" when requesting rows from Druid

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.11.0
    • druid-adapter
    • None

    Description

      Druid adapter gets an error while fetching data. As mentioned in Druid documentation,

      Note that in the second query, an offset is specified and that it is 1 greater than the largest offset found in the initial results. To return the next "page", this offset must be incremented by 1 (should be decremented by 1 for descending query), with each new query, but with option fromNext enabled, this operation is not needed. When an empty results set is received, the very last page has been returned.

      I think Druid adapter presumes this feature is turned on but it's not set in code.

      Also, previousOffset may not be reasonable, see DruidQuery. I think whether we have already fetched all data is decided by the next request. If we don't have any data returned on next request, that means fetching is done.

      Attachments

        Activity

          People

            julianhyde Julian Hyde
            VcamX Jiarong Wei
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: