Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2554

Spark action tests on yarn-cluster, yarn-client mode

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Currently, we have unit test cases for Spark Action in local mode. To verify other functionality, we should have tests in yarn-cluster and yarn-client mode.

      Attachments

        1. OOZIE-2554.poc.patch
          8 kB
          Gézapeti

        Issue Links

        is blocked by

        Improvement - An improvement or enhancement to an existing feature or task. OOZIE-2729 Use MiniMRYARNCluster in tests

        • Major - Major loss of function.
        • In Progress
        is depended upon by

        Bug - A problem which impairs or prevents the functions of the product. OOZIE-3064 Add Spark SQL test for spark action

        • Major - Major loss of function.
        • Open
        is related to

        Bug - A problem which impairs or prevents the functions of the product. OOZIE-2194 oozie job -kill doesn't work with spark action

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. OOZIE-2787 Oozie distributes application jar twice making the spark job fail

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. OOZIE-2790 log4j configuration is not passed to spark executors

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. OOZIE-2799 Setting log location for spark sql on hive

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. OOZIE-2547 Add mapreduce.job.cache.files to spark action

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. OOZIE-2563 pass spark-defaults.conf to spark action

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            satishsaley Satish Saley
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment