Uploaded image for project: 'Falcon'
  1. Falcon
  2. FALCON-1627

Provider integration with Azure Data Factory pipelines

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9
    • Fix Version/s: 0.10
    • Component/s: None
    • Labels:
      None

      Description

      Micrsosoft Azure Data Factory is Data processing service available on Microsoft Azure environment which allows users to compose, orchestrate and manage data pipelines somewhat similar to Falcon on the azure environment.

      The integration will allow ADF to invoke a Falcon activity (replication, hive or pig proessing work) from the Azure Data Factory data pipeline so that Azure cloud and Hadoop onprem processing can be realized.

      The integration work has a few steps and will also be enhanced when ADF V3 protocol is introduced

        Attachments

        1. FALCON-1627.patch
          105 kB
          Venkat Ranganathan
        2. ADFTutorial.pdf
          1.37 MB
          Venkat Ranganathan
        3. ADF JSON Message Definition.pdf
          191 kB
          Venkat Ranganathan

          Activity

            People

            • Assignee:
              ying-eng Ying Zheng
              Reporter:
              venkatnrangan Venkat Ranganathan
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: