Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1504

Allow specifying a fixed instance as the start instance of a data-in

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • trunk
    • 4.1.0
    • None
    • None

    Description

      Usage-case...

      One wants it to start on the same specific date so that each day, it processes one more data set than the last day (the datasets are daily). Something like the following

      <input-events>
      <data-in name="event_input_path_format1" dataset="EVENT_INPUT_FORMAT1">
      <start-instance>${coord:absolute(2013-03-15T00:00Z)}</start-instance>
      <end-instance>$

      {coord:current(-1)}

      </end-instance>
      </data-in>
      <data-in name="event_input_path_format2" dataset="EVENT_INPUT_FORMAT2">
      <start-instance>${coord:absolute(2013-03-15T00:00Z)}</start-instance>
      <end-instance>$

      {coord:current(-1)}

      </end-instance>
      </data-in>
      </input-events>
      ---------------------------------

      Specifying a fixed date as the start instance is useful if processing needs to process all dataset instances from a specific instance to the current instance.

      Attachments

        1. OOZIE-1504_v4.patch
          35 kB
          Purshotam Shah

        Activity

          People

            puru Purshotam Shah
            egashira Ryota Egashira
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: