Description
It would be quite handy to support scheduling as a capability in the Lens system to allow users to submit a query with a repeatable schedule. For ex. I should be able to submit a query and expect that to be running the first monday of every month or first day of every month over a moving data window.
The list of features that need to be supported with this are
1. Parameterization of queries to allow fixed, moving time windows
2. Allow Cron style scheduling & specific weekday or specific day of month etc
3. Allow scheduled queries to be paced in such a way that regular queries that users are submitting point in time don't suffer
4. Allow gating of the scheduled queries based on partition availability. It shouldn't happen that ideally query is run in low cost engine and due to data availability delays, the system chooses a higher cost engine because of availability of data earlier in that system. In some cases that may be acceptable as well. But the choice should be conscious.
5.Handling query failures in the schedule and being able to run them again through administrative levers
6. Administrative levers to repeating the entire schedule due to errors in data, requiring re-publishing the reports.
7. Support query stats analysis over scheduled queries
Attachments
Issue Links
- is duplicated by
-
LENS-124 Add scheduler service on lens
-
- Open
-