Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-41589

PyTorch Distributor

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Reopened
    • Critical
    • Resolution: Unresolved
    • 3.4.0
    • None
    • ML, PySpark
    • None

    Description

      This is a project to make it easier for PySpark users to distribute PyTorch code using PySpark. The corresponding Design Document can give more context. This was a project determined by the Databricks ML Training Team; please reach out to gurwls223 (Spark-side) or erithwik for more context.

      Attachments

        Activity

          People

            Unassigned Unassigned
            erithwik Rithwik Ediga Lakhamsani
            Hyukjin Kwon Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated: