Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-5977

predicate pushdown support kafkaMsgOffset

    Details

      Description

      As part of Kafka storage plugin review, below is the suggestion from Paul.

      Does it make sense to provide a way to select a range of messages: a starting point or a count? Perhaps I want to run my query every five minutes, scanning only those messages since the previous scan. Or, I want to limit my take to, say, the next 1000 messages. Could we use a pseudo-column such as "kafkaMsgOffset" for that purpose? Maybe
      
      SELECT * FROM <some topic> WHERE kafkaMsgOffset > 12345
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                aravi5 Abhishek Ravi
                Reporter:
                akumarb2010 B Anil Kumar
                Reviewer:
                B Anil Kumar
              • Votes:
                1 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: