Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3145

Hive on Spark umbrella

    XMLWordPrintableJSON

    Details

    • Type: Epic
    • Status: Resolved
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Build, Shuffle, Spark Core
    • Labels:
      None

      Description

      This is an umbrella jira to point to dependency & asks from the Hive-on-Spark project (HIVE-7292).

        Attachments

          Issue Links

          depends upon

          Sub-task - The sub-task of the issue SPARK-1021 sortByKey() launches a cluster job when it shouldn't

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue SPARK-2848 Shade Guava in Spark deliverables

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-4687 SparkContext#addFile doesn't keep file folder information

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-4921 TaskSetManager mistakenly returns PROCESS_LOCAL for NO_PREF tasks

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-4955 Dynamic allocation doesn't work in YARN cluster mode

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. SPARK-2387 Remove the stage barrier for better resource utilization

          • Major - Major loss of function.
          • In Progress

          New Feature - A new feature of the product, which has yet to be developed. SPARK-2633 enhance spark listener API to gather more spark job information

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-2636 Expose job ID in JobWaiter API

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-2688 Need a way to run multiple data pipeline concurrently

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-2895 Support mapPartitionsWithContext in Spark Java API

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-2978 Provide an MR-style shuffle transformation

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-3199 native Java spark listener API support

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-3215 Add remote interface for SparkContext

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-3446 FutureAction should expose the job ID

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-3590 Expose async APIs in the Java API

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3621 Provide a way to broadcast an RDD (instead of just a variable made of the RDD) so that a job can access

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3622 Provide a custom transformation that can output multiple RDDs

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-4290 Provide an equivalent functionality of distributed cache as MR does

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-4440 Enhance the job progress API to expose more information

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-4567 Make SparkJobInfo and SparkStageInfo serializable

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-5080 Expose more cluster resource information to user

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-5199 Input metrics should show up for InputFormats that return CombineFileSplits

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-5377 Dynamically add jar into Spark Driver's classpath.

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-5439 Expose yarn app id for yarn mode

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3174 Provide elastic scaling within a Spark application

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-4585 Spark dynamic executor allocation shouldn't use maxExecutors as initial number

          • Major - Major loss of function.
          • Closed

          Test - A new unit, integration or system test. SPARK-3691 Provide a mini cluster for testing system built on Spark

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                bcwalrus bc Wong
              • Votes:
                0 Vote for this issue
                Watchers:
                16 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: