Uploaded image for project: 'Metron (Retired)'
  1. Metron (Retired)
  2. METRON-690

Create a DSL-based timestamp lookup for profiler to enable sparse windows

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Done
    • Major
    • Resolution: Done
    • None
    • 0.4.0
    • None

    Description

      I propose that we support the following features:

      • A starting point that is not current time
      • Sparse bins (i.e. the last hour for every tuesday for the last month)
      • The ability to skip events (e.g. weekends, holidays)

      This would result in a new function with the following arguments:
      from - The lookback starting point (default to now)

      fromUnits - The units for the lookback starting point

      to - The ending point for the lookback window (default to from + binSize)

      toUnits - The units for the lookback ending point

      including - A list of conditions which we would skip.

      weekend
      holiday
      sunday through saturday
      excluding - A list of conditions which we would skip.

      weekend
      holiday
      sunday through saturday
      binSize - The size of the lookback bin

      binUnits - The units of the lookback bin

      Given the number of arguments and their complexity and the fact that many, many are optional,
      PROFILE_LOOKBACK accept a string backed by a DSL to express these criteria

      Base Case: A lookback of 1 hour ago

      PROFILE_LOOKBACK( '1 hour bins from now')

      Example 1: The same time window every tuesday for the last month starting one hour ago

      Just to make this as clear as possible, if this is run at 3PM on Monday January 23rd, 2017, it would include the following bins:
      January 17th, 2PM - 3PM
      January 10th, 2PM - 3PM
      January 3rd, 2PM - 3PM
      December 27th, 2PM - 3PM

      PROFILE_LOOKBACK( '1 hour bins from 1 hour to 1 month including tuesdays')

      Example 2: The same time window every sunday for the last month starting one hour ago skipping holidays

      Just to make this as clear as possible, if this is run at 3PM on Monday January 22rd, 2017, it would include the following bins:
      January 16th, 2PM - 3PM
      January 9th, 2PM - 3PM
      January 2rd, 2PM - 3PM
      NOT December 25th

      PROFILE_LOOKBACK( '1 hour bins from 1 hour to 1 month including tuesdays excluding holidays')

      Attachments

        Issue Links

          Activity

            People

              cestella Casey Stella
              cestella Casey Stella
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: