Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2554

Spark action tests on yarn-cluster, yarn-client mode

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Currently, we have unit test cases for Spark Action in local mode. To verify other functionality, we should have tests in yarn-cluster and yarn-client mode.

      Attachments

        1. OOZIE-2554.poc.patch
          8 kB
          Gézapeti

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. OOZIE-2729 Use MiniMRYARNCluster in tests

          • Major - Major loss of function.
          • In Progress
          is depended upon by

          Bug - A problem which impairs or prevents the functions of the product. OOZIE-3064 Add Spark SQL test for spark action

          • Major - Major loss of function.
          • Open
          is related to

          Bug - A problem which impairs or prevents the functions of the product. OOZIE-2194 oozie job -kill doesn't work with spark action

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. OOZIE-2787 Oozie distributes application jar twice making the spark job fail

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. OOZIE-2790 log4j configuration is not passed to spark executors

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. OOZIE-2799 Setting log location for spark sql on hive

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. OOZIE-2547 Add mapreduce.job.cache.files to spark action

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. OOZIE-2563 pass spark-defaults.conf to spark action

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              Unassigned Unassigned
              satishsaley Satish Saley
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: