Public signup for this instance is disabled. Go to our Self serve sign up page to request an account. Report potential security issues privately

  1. Sub-task SPARK-50511
    Avoid wrapping Python data source error messages thrown during planning
  2. Sub-task SPARK-50471
    Support Arrow-Based Python Data Source Writer
  3. Sub-task SPARK-50426
    Avoid static Python data source lookup when using builtin or Java data sources
  4. Sub-task SPARK-50348
    Make static import Python data source configurable
  5. Sub-task SPARK-48785
    Add a simple data source example in the user guide
  6. Sub-task SPARK-48653
    Fix Python data source error class references
  7. Sub-task SPARK-48646
    Refine Python data source API docstring and type hints
  8. Sub-task SPARK-48497
    Add user guide for batch data source write API
  9. Sub-task SPARK-48493
    Enhance Python Datasource Reader with Arrow Batch Support for Improved Performance
  10. Sub-task SPARK-48205
    Remove the private[sql] modifier for Python data sources
  11. Sub-task SPARK-47439
    Document Python Data Source API in API reference page
  12. Sub-task SPARK-47436
    Fix docstring links and type hints in Python Data Source
  13. Sub-task SPARK-47367
    Support Python data source API with Spark Connect
  14. Sub-task SPARK-47346
    Make daemon mode configurable when creating Python workers
  15. Sub-task SPARK-46973
    Skip V2 table lookup when a table is in V1 table cache
  16. Sub-task SPARK-46751
    Skip test_datasource if PyArrow is not installed
  17. Sub-task SPARK-46720
    Refactor Python Data Source to align with other built-in Data Sources
  18. Sub-task SPARK-46670
    Make DataSourceManager isolated and self clone-able
  19. Sub-task SPARK-46618
    Improve error messages for DATA_SOURCE_NOT_FOUND error
  20. Sub-task SPARK-46616
    Disallow re-registration of statically registered data sources
  21. Sub-task SPARK-46613
    Log full exception when failed to lookup Python Data Sources
  22. Sub-task SPARK-46576
    Improve error messages for unsupported data source save mode
  23. Sub-task SPARK-46568
    Python data source options should be a case insensitive dictionary
  24. Sub-task SPARK-46565
    Improve Python data source error classes and messages
  25. Sub-task SPARK-46540
    Respect column names when Python data source read function outputs named Row objects
  26. Sub-task SPARK-46530
    Check Python executable when looking up available Data Sources
  27. Sub-task SPARK-46524
    Improve error messages for invalid save mode
  28. Sub-task SPARK-46522
    Block Python data source registration with name conflicts
  29. Sub-task SPARK-46520
    Support overwrite mode for Python data source write
  30. Sub-task SPARK-46452
    Add a new API in DSv2 DataWriter to write an iterator of records
  31. Sub-task SPARK-46424
    Support PythonSQLMetrics.pythonMetrics
  32. Sub-task SPARK-46423
    Refactor Python Data Source instance loading
  33. Sub-task SPARK-46375
    Add documentation for Python data source API
  34. Sub-task SPARK-46290
    Change saveMode to overwrite for DataSourceWriter constructor
  35. Sub-task SPARK-46273
    Support INSERT INTO/OVERWRITE using DSv2 sources
  36. Sub-task SPARK-46272
    Support CTAS using DSv2 sources
  37. Sub-task SPARK-46253
    Plan Python data source read using mapInArrow
  38. Sub-task SPARK-46043
    Support create table using DSv2 sources
  39. Sub-task SPARK-45940
    Add InputPartition to DataSourceReader interface
  40. Sub-task SPARK-45930
    Allow non-deterministic Python UDFs in MapInPandas/MapInArrow
  41. Sub-task SPARK-45927
    Update `path` handling in Python data source
  42. Sub-task SPARK-45917
    Statically register Python Data Source
  43. Sub-task SPARK-45916
    Investigate runtime registration and feasibility of overwriting the datasource
  44. Sub-task SPARK-45914
    Support `commit` and `abort` API for Python data source write
  45. Sub-task SPARK-45713
    Support registering Python data sources
  46. Sub-task SPARK-45654
    Add Python data source write API
  47. Sub-task SPARK-45639
    Support loading Python data sources in DataFrameReader
  48. Sub-task SPARK-45600
    Make Python data source registration session level
  49. Sub-task SPARK-45597
    Support creating table using a Python data source in SQL
  50. Sub-task SPARK-45560
    Support spark.read.load() with non-empty path for Python data source API
Refresh results