Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13458

Datasets cannot be sorted

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.6.0
    • None
    • SQL
    • None

    Description

      There doesn't appear to be any way to sort a Dataset at present, without first converting it to a DataFrame.

      Methods like orderBy, sort, and sortWithinPartitions which are present on DataFrame, or sortBy which is present on RDD, are absent.

      Attachments

        Issue Links

          duplicates

          Sub-task - The sub-task of the issue SPARK-13244 Unify DataFrame and Dataset API

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue SPARK-13244 Unify DataFrame and Dataset API

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              obeattie Oliver Beattie
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: