[LENS-251] Support to query streaming data sources

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.3
• Component/s: cube
• Labels: Hackathon-July
• Assignee: Sharad Agarwal
• Reporter: Sharad Agarwal
• Created: 30/Jan/15 04:27
• Updated: 25/Aug/15 11:26
• Resolved: 28/Jul/15 11:08

Description

For certain stores that allows streaming ingestion, to make the data available immediately for querying, we need the notion of streaming update period or some such.
Describing by example:

• lets say there are two drivers - D1 and D2.
• D1 queries storage S1
• D2 queries storage S2
  S1 and S2 are part of the same Cube.

In S1 data is in hourly granularity loaded every hour, while S2 has data being ingested continuously in streaming fashion and maintains last 5 hours window of data.
Now based on the query time range we want to select the right driver.

Issue Links

• relates to: LENS-698 Findbug error in PopulateSampleMetastore