Uploaded image for project: 'Falcon'
  1. Falcon
  2. FALCON-1763

Create a spark execution engine for Falcon

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • trunk, 0.10
    • None
    • None

    Description

      It would be great to get a spark execution engine for Falcon along with the existing Oozie wf, Pig and Hive support. This will greatly help in easing the use of Spark jobs to use with Falcon data management.

      We should make sure that this support works with all Falcon deployment modes (embedded, distributed, secure, non secure) and also diffrenent Spark application modes(standalone, yarn client, yarn standalone etc)

      Attachments

        1. SparkexecutionenginewithFalcon.pdf
          71 kB
          Peeyush Bishnoi

        Activity

          People

            peeyushb Peeyush Bishnoi
            venkatnrangan Venkat Ranganathan
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: