Uploaded image for project: 'Falcon'
  1. Falcon
  2. FALCON-1560

Lifecycle does not allow feed with frequency greater than days(1)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.8
    • trunk, 0.8
    • None
    • None

    Description

      While submitting feed with optional lifecycle frequency it fails with following error :

      <?xml version="1.0" encoding="UTF-8"?><result>
        <status>FAILED</status>
        <message>ua1/Retention can not be more frequent than data availability.
      </message>
        <requestId>ua1/1309176095@qtp-2030538903-0 - 83c96042-fb26-4b3a-8f47-f855581a5f97
      </requestId>
      </result>
      

      Feed definition is :

      <?xml version="1.0" encoding="UTF-8"?><feed xmlns="uri:falcon:feed:0.1" name="A520c018d-439b98aa" description="clicks log">
          <frequency>days(2)</frequency>
          <timezone>UTC</timezone>
          <late-arrival cut-off="days(2)"/>
          <clusters>
              <cluster name="A520c018d-699dd88a" type="source">
                  <validity start="2012-01-30T00:00Z" end="2099-03-31T23:59Z"/>
                  <retention limit="days(6)" action="delete"/>
              </cluster>
          </clusters>
          <locations>
              <location type="data" path="/tmp/falcon-regression/LifecycleHourlyTest/testFolders/${YEAR}/${MONTH}/${DAY}"/>
              <location type="stats" path="/projects/falcon/clicksStats"/>
              <location type="meta" path="/projects/falcon/clicksMetaData"/>
          </locations>
          <ACL owner="pragya" group="dataqa" permission="*"/>
          <schema location="/schema/clicks" provider="protobuf"/>
          <properties/>
          <lifecycle>
              <retention-stage>
                  <queue>default</queue>
                  <priority>HIGH</priority>
                  <properties>
                      <property name="retention.policy.agebaseddelete.limit" value="days(10)"/>
                  </properties>
              </retention-stage>
          </lifecycle>
      </feed>
      

      Same behaviour goes for feed having frequency > hours(6)

      Attachments

        1. FALCON-1560.patch
          3 kB
          Ajay Yadav
        2. FALCON-1560-V1.patch
          5 kB
          Ajay Yadav
        3. FALCON-1560-V2.patch
          5 kB
          Ajay Yadav

        Issue Links

          Activity

            People

              ajayyadava Ajay Yadav
              pragya.mittal Pragya Mittal
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: