Export - CSV (All fields)
Export - CSV (Current fields)
SPARK-22430
Unknown tag warnings when building R docs with Roxygen 6.0.1SPARK-24094
Change description strings of v2 streaming sources to reflect the change
PrintToStderr should behave the same in interpreted mode
Spark on Kubernetes Pod Watcher dumps raw container status
Add optional logging to UnsafeProjection.create when it falls back to interpreted mode
Spark Shell should show the Scala prompt after initialization is complete
The schema of MapType can not be printed correctly
YarnAllocator should have same blacklist behaviour with YARN to maxmize use of cluster resource
Minor bugs from comparing unrelated types
SPARK-24740
PySpark tests do not pass with NumPy 0.14.x+
SHS needs synchronization between attachSparkUI and detachSparkUI functions
Add Trigger information to the Structured Streaming programming guide
Integration tests pass only one app argument
Add Integration tests for Secrets
ml.image doesn't have __all__ explicitly defined
Remove unused code and fix any related doc in K8s module
PySpark/SparkR doc doesn't explain RandomForestClassifier.featureSubsetStrategy well
generateLDAData in ml.cluster.LDASuite didn't set seed correctly
Make consumer creation lazy in Kafka source for Structured streaming
Spark code contains numerous undefined names in Python 3SPARK-23601
Remove .md5 files from release
PySpark CountVectorizerModel should be able to construct from vocabulary list
Add file filtering interface for FileFormat
Support minPartitions parameter for JSON and CSV datasources as options
support complex aggregate buffer in HashAggregateExec
estimate size of object buffer for object hash aggregate
Use spark.streaming.backpressure.initialRate in DirectKafkaInputDStream
Update structured streaming kafka from 0.10.0.1 to 2.0.0
CSV data source treats empty string as null no matter what nullValue option is
Prepare ColumnVector implementation for UnsafeData- SPARK-22883
ML test for StructuredStreaming: spark.ml.feature, A-M SPARK-23046
Have RFormula include VectorSizeHint in pipeline
Bump master branch version to 2.4.0-SNAPSHOT
Reset configuration when restarting from checkpointsSPARK-23146
Support client mode for Kubernetes cluster backend
Add new API in DataSourceWriter: onDataWriterCommit
Make sure all expressions support interpreted evaluation
Support Filter in ConvertToLocalRelation
require memberhip in wheel to run 'su' (in dockerfiles)
Remove dangerous parmap
Optimization in Dataset.apply for DataFrames
Fix several bugs in failure handling of barrier execution mode
json schema inference should only trigger one job
Add an example for having two columns as the grouping key in group aggregate pandas UDF
ML, Graph 2.4 QA: Programming guide update and migration guide
ML, Graph 2.4 QA: Update user guide for new features & APIs
ML 2.4 QA: API: Python API coverage
Block Manager master and slave thread pools are unbounded
Document the features that require Pyarrow 0.10
VectorSizeHint.size is buggy, breaking streaming pipeline