Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-5166

Stabilize Spark SQL APIs

          Details

          • Type: Task
          • Status: Resolved
          • Priority: Blocker
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: 1.3.0
          • Component/s: SQL
          • Labels:
          • Target Version/s:

            Description

            Before we take Spark SQL out of alpha, we need to audit the APIs and stabilize them.

            As a general rule, everything under org.apache.spark.sql.catalyst should not be exposed.

              Attachments

                Issue Links

                is related to

                Umbrella - An overarching type made of sub-tasks SPARK-6116 DataFrame API improvement umbrella ticket (Spark 1.5)

                • Critical - Crashes, loss of data, severe memory leak.
                • Resolved
                relates to

                Bug - A problem which impairs or prevents the functions of the product. SPARK-4988 "Create table ..as select ..from..order by .. limit 10" report error when one col is a Decimal

                • Major - Major loss of function.
                • Resolved

                Bug - A problem which impairs or prevents the functions of the product. SPARK-2096 Correctly parse dot notations for accessing an array of structs

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Resolved

                Story - Created by JIRA Software - do not edit or delete. Issue type for a user story. SPARK-5180 Data source API improvement (Spark 1.5)

                • Blocker - Blocks development and/or testing work, production could not run
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. SPARK-5135 Add support for describe [extended] table to DDL in SQLContext

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. SPARK-5061 SQLContext: overload createParquetFile

                • Major - Major loss of function.
                • Closed

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-4945 Add overwrite option support for SchemaRDD.saveAsParquetFile

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Closed
                links to

                Pull request #4642 [Github] Pull Request #4642 (marmbrus)

                There are no Sub-Tasks for this issue.

                  Activity

                    People

                    • Assignee:
                      rxin Reynold Xin
                      Reporter:
                      rxin Reynold Xin
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      7 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: