Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25299 Use remote storage for persisting shuffle data
  3. SPARK-28592

Mark new Shuffle apis as @Experimental (instead of @Private)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.1.0
    • None
    • Shuffle, Spark Core
    • None

    Description

      The new Shuffle api is initially marked as @Private, just to discourage anyone from trying to make use of it before all the pieces are in place (in particular if spark 3.0 is released before everything is merged).  But once its all merged we can change to @Experimental

      Attachments

        Activity

          People

            Unassigned Unassigned
            irashid Imran Rashid
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: