Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-11410

Add a DataFrame API that provides functionality similar to HiveQL's DISTRIBUTE BY

          Details

          • Type: Improvement
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 1.5.1
          • Fix Version/s: 1.6.0
          • Component/s: SQL
          • Labels:
            None
          • Target Version/s:

            Description

            DISTRIBUTE BY allows the user to control the partitioning and ordering of a data set which can be very useful for some applications.

              Attachments

                Issue Links

                is related to

                Sub-task - The sub-task of the issue SPARK-11504 API audit for distributeBy and localSort

                • Major - Major loss of function.
                • Resolved

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-4849 Pass partitioning information (distribute by) to In-memory caching

                • Critical - Crashes, loss of data, severe memory leak.
                • Resolved
                links to

                Pull request #9364 [Github] Pull Request #9364 (nongli)

                Pull request #9504 [Github] Pull Request #9504 (nongli)

                  Activity

                    People

                    • Assignee:
                      nongli Nong Li
                      Reporter:
                      nongli Nong Li
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      7 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: