Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1504

Allow specifying a fixed instance as the start instance of a data-in

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: trunk
    • Fix Version/s: 4.1.0
    • Component/s: None
    • Labels:
      None

      Description

      Usage-case...

      One wants it to start on the same specific date so that each day, it processes one more data set than the last day (the datasets are daily). Something like the following

      <input-events>
      <data-in name="event_input_path_format1" dataset="EVENT_INPUT_FORMAT1">
      <start-instance>${coord:absolute(2013-03-15T00:00Z)}</start-instance>
      <end-instance>$

      {coord:current(-1)}

      </end-instance>
      </data-in>
      <data-in name="event_input_path_format2" dataset="EVENT_INPUT_FORMAT2">
      <start-instance>${coord:absolute(2013-03-15T00:00Z)}</start-instance>
      <end-instance>$

      {coord:current(-1)}

      </end-instance>
      </data-in>
      </input-events>
      ---------------------------------

      Specifying a fixed date as the start instance is useful if processing needs to process all dataset instances from a specific instance to the current instance.

        Attachments

        1. OOZIE-1504_v4.patch
          35 kB
          Purshotam Shah

          Activity

            People

            • Assignee:
              puru Purshotam Shah
              Reporter:
              egashira Ryota Egashira
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: