Uploaded image for project: 'Falcon'
  1. Falcon
  2. FALCON-1763

Create a spark execution engine for Falcon

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: trunk, 0.10
    • Component/s: None
    • Labels:
      None

      Description

      It would be great to get a spark execution engine for Falcon along with the existing Oozie wf, Pig and Hive support. This will greatly help in easing the use of Spark jobs to use with Falcon data management.

      We should make sure that this support works with all Falcon deployment modes (embedded, distributed, secure, non secure) and also diffrenent Spark application modes(standalone, yarn client, yarn standalone etc)

        Attachments

        1. SparkexecutionenginewithFalcon.pdf
          71 kB
          Peeyush Bishnoi

          Activity

            People

            • Assignee:
              peeyushb Peeyush Bishnoi
              Reporter:
              venkatnrangan Venkat Ranganathan
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: