Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-5977

predicate pushdown support kafkaMsgOffset

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      As part of Kafka storage plugin review, below is the suggestion from Paul.

      Does it make sense to provide a way to select a range of messages: a starting point or a count? Perhaps I want to run my query every five minutes, scanning only those messages since the previous scan. Or, I want to limit my take to, say, the next 1000 messages. Could we use a pseudo-column such as "kafkaMsgOffset" for that purpose? Maybe
      
      SELECT * FROM <some topic> WHERE kafkaMsgOffset > 12345
      

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            aravi5 Abhishek Ravi
            akumarb2010 AnilKumar B
            AnilKumar B AnilKumar B
            Votes:
            1 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment