Uploaded image for project: 'Falcon'
  1. Falcon
  2. FALCON-796

Enable users to triage data processing issues through falcon

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.7
    • Component/s: None
    • Labels:
      None

      Description

      Falcon has a wealth of information that can help users to triage issues relating to their pipelines, but this information is not available in a consumable form to the users. Here is a suggestion to solve for this issue to some extent.

      In a typical usage scenario, users may find that their data has not been generated and that would require them to walk up the dependency tree to identify the root cause. Luckily all this information is available within Falcon and can be surfaced.

      A mock of how this would look:

      falcon instance -type feed -name FEED-abc -start 2014-10-01T00:00Z -end 2014-10-01T00:00Z -triage

      FEED-abc/2014-10-01T00:00Z MISSING
        + PROCESS-def/2014-10-02T04:00Z WAITING
          + FEED-ghi/2014-10-01T00:00Z MISSING
            + PROCESS-mno/2014-10-01T01:30Z  RUNNING
          + FEED-ghi/2014-10-01T01:00Z MISSING
            + PROCESS-mno/2014-10-01T02:30Z  FAILED
          + FEED-ghi/*                 AVAIALBLE
          + FEED-jkl/*                 AVAILABLE
      

      falcon instance -type feed -name FEED-abc -start 2014-09-01T00:00Z -end 2014-09-01T00:00Z -triage

      FEED-abc/2014-09-01T00:00Z AVAILABLE
      

      falcon instance -type process -name PROCESS-def -start 2014-10-01T00:00Z -end 2014-10-01T00:00Z -triage

      PROCESS-def/2014-10-02T04:00Z WAITING
        + FEED-ghi/2014-10-01T00:00Z MISSING
          + PROCESS-mno/2014-10-01T01:30Z  RUNNING
        + FEED-ghi/2014-10-01T01:00Z MISSING
          + PROCESS-mno/2014-10-01T02:30Z  FAILED
        + FEED-ghi/*                 AVAIALBLE
        + FEED-jkl/*                 AVAILABLE
      

        Attachments

        1. FALCON-796-v2.patch
          28 kB
          Ajay Yadava
        2. FALCON-796.patch
          28 kB
          Ajay Yadava
        3. FALCON-796.patch
          31 kB
          Ajay Yadava

          Issue Links

            Activity

              People

              • Assignee:
                ajayyadava Ajay Yadava
                Reporter:
                sriksun Srikanth Sundarrajan
              • Votes:
                1 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: