Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3145

Hive on Spark umbrella

          Details

          • Type: Epic
          • Status: Resolved
          • Priority: Major
          • Resolution: Done
          • Affects Version/s: None
          • Fix Version/s: None
          • Component/s: Build, Shuffle, Spark Core
          • Labels:
            None

            Description

            This is an umbrella jira to point to dependency & asks from the Hive-on-Spark project (HIVE-7292).

              Attachments

                Issue Links

                depends upon

                Sub-task - The sub-task of the issue SPARK-1021 sortByKey() launches a cluster job when it shouldn't

                • Major - Major loss of function.
                • Resolved

                Sub-task - The sub-task of the issue SPARK-2848 Shade Guava in Spark deliverables

                • Major - Major loss of function.
                • Resolved

                Bug - A problem which impairs or prevents the functions of the product. SPARK-4687 SparkContext#addFile doesn't keep file folder information

                • Major - Major loss of function.
                • Resolved

                Bug - A problem which impairs or prevents the functions of the product. SPARK-4921 TaskSetManager mistakenly returns PROCESS_LOCAL for NO_PREF tasks

                • Major - Major loss of function.
                • Resolved

                Bug - A problem which impairs or prevents the functions of the product. SPARK-4955 Dynamic allocation doesn't work in YARN cluster mode

                • Blocker - Blocks development and/or testing work, production could not run
                • Closed

                New Feature - A new feature of the product, which has yet to be developed. SPARK-2387 Remove the stage barrier for better resource utilization

                • Major - Major loss of function.
                • In Progress

                New Feature - A new feature of the product, which has yet to be developed. SPARK-2633 enhance spark listener API to gather more spark job information

                • Critical - Crashes, loss of data, severe memory leak.
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. SPARK-2636 Expose job ID in JobWaiter API

                • Major - Major loss of function.
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. SPARK-2688 Need a way to run multiple data pipeline concurrently

                • Major - Major loss of function.
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. SPARK-2895 Support mapPartitionsWithContext in Spark Java API

                • Major - Major loss of function.
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. SPARK-2978 Provide an MR-style shuffle transformation

                • Major - Major loss of function.
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. SPARK-3199 native Java spark listener API support

                • Major - Major loss of function.
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. SPARK-3215 Add remote interface for SparkContext

                • Major - Major loss of function.
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. SPARK-3446 FutureAction should expose the job ID

                • Major - Major loss of function.
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. SPARK-3590 Expose async APIs in the Java API

                • Major - Major loss of function.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-3621 Provide a way to broadcast an RDD (instead of just a variable made of the RDD) so that a job can access

                • Major - Major loss of function.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-3622 Provide a custom transformation that can output multiple RDDs

                • Major - Major loss of function.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-4290 Provide an equivalent functionality of distributed cache as MR does

                • Major - Major loss of function.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-4440 Enhance the job progress API to expose more information

                • Major - Major loss of function.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-4567 Make SparkJobInfo and SparkStageInfo serializable

                • Major - Major loss of function.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-5080 Expose more cluster resource information to user

                • Major - Major loss of function.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-5199 Input metrics should show up for InputFormats that return CombineFileSplits

                • Major - Major loss of function.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-5377 Dynamically add jar into Spark Driver's classpath.

                • Major - Major loss of function.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-5439 Expose yarn app id for yarn mode

                • Major - Major loss of function.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-3174 Provide elastic scaling within a Spark application

                • Major - Major loss of function.
                • Closed

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-4585 Spark dynamic executor allocation shouldn't use maxExecutors as initial number

                • Major - Major loss of function.
                • Closed

                Test - A new unit, integration or system test. SPARK-3691 Provide a mini cluster for testing system built on Spark

                • Major - Major loss of function.
                • Closed

                  Activity

                    People

                    • Assignee:
                      Unassigned
                      Reporter:
                      bcwalrus bc Wong
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      16 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: