Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3145

Hive on Spark umbrella

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Epic
    • Status: Resolved
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Build, Shuffle, Spark Core
    • Labels:
      None

      Description

      This is an umbrella jira to point to dependency & asks from the Hive-on-Spark project (HIVE-7292).

        Attachments

        Issue Links

        depends upon

        Sub-task - The sub-task of the issue SPARK-1021 sortByKey() launches a cluster job when it shouldn't

        • Major - Major loss of function.
        • Resolved

        Sub-task - The sub-task of the issue SPARK-2848 Shade Guava in Spark deliverables

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. SPARK-4687 SparkContext#addFile doesn't keep file folder information

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. SPARK-4921 TaskSetManager mistakenly returns PROCESS_LOCAL for NO_PREF tasks

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. SPARK-4955 Dynamic allocation doesn't work in YARN cluster mode

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. SPARK-2387 Remove the stage barrier for better resource utilization

        • Major - Major loss of function.
        • In Progress

        New Feature - A new feature of the product, which has yet to be developed. SPARK-2633 enhance spark listener API to gather more spark job information

        • Critical - Crashes, loss of data, severe memory leak.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. SPARK-2636 Expose job ID in JobWaiter API

        • Major - Major loss of function.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. SPARK-2688 Need a way to run multiple data pipeline concurrently

        • Major - Major loss of function.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. SPARK-2895 Support mapPartitionsWithContext in Spark Java API

        • Major - Major loss of function.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. SPARK-2978 Provide an MR-style shuffle transformation

        • Major - Major loss of function.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. SPARK-3199 native Java spark listener API support

        • Major - Major loss of function.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. SPARK-3215 Add remote interface for SparkContext

        • Major - Major loss of function.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. SPARK-3446 FutureAction should expose the job ID

        • Major - Major loss of function.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. SPARK-3590 Expose async APIs in the Java API

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-3621 Provide a way to broadcast an RDD (instead of just a variable made of the RDD) so that a job can access

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-3622 Provide a custom transformation that can output multiple RDDs

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-4290 Provide an equivalent functionality of distributed cache as MR does

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-4440 Enhance the job progress API to expose more information

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-4567 Make SparkJobInfo and SparkStageInfo serializable

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-5080 Expose more cluster resource information to user

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-5199 Input metrics should show up for InputFormats that return CombineFileSplits

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-5377 Dynamically add jar into Spark Driver's classpath.

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-5439 Expose yarn app id for yarn mode

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-3174 Provide elastic scaling within a Spark application

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. SPARK-4585 Spark dynamic executor allocation shouldn't use maxExecutors as initial number

        • Major - Major loss of function.
        • Closed

        Test - A new unit, integration or system test. SPARK-3691 Provide a mini cluster for testing system built on Spark

        • Major - Major loss of function.
        • Closed
        There are no issues in this epic.

          Activity
          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              Unassigned
              Reporter:
              bcwalrus bc Wong

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment