Export - CSV (All fields)
Export - CSV (Current fields)
SPARK-24094
Change description strings of v2 streaming sources to reflect the changeSPARK-23602
PrintToStderr should behave the same in interpreted mode
Unknown tag warnings when building R docs with Roxygen 6.0.1
Support minPartitions parameter for JSON and CSV datasources as options
PySpark CountVectorizerModel should be able to construct from vocabulary list
Add file filtering interface for FileFormat
Remove unused code and fix any related doc in K8s module
Spark code contains numerous undefined names in Python 3
ml.image doesn't have __all__ explicitly defined
YarnAllocator should have same blacklist behaviour with YARN to maxmize use of cluster resource
Add optional logging to UnsafeProjection.create when it falls back to interpreted mode
Spark Shell should show the Scala prompt after initialization is complete
Minor bugs from comparing unrelated types
Spark on Kubernetes Pod Watcher dumps raw container status
Make consumer creation lazy in Kafka source for Structured streaming
generateLDAData in ml.cluster.LDASuite didn't set seed correctlySPARK-23601
Remove .md5 files from release
Add Trigger information to the Structured Streaming programming guide
SHS needs synchronization between attachSparkUI and detachSparkUI functions
SPARK-24740
PySpark tests do not pass with NumPy 0.14.x+
The schema of MapType can not be printed correctly
Integration tests pass only one app argument
PySpark/SparkR doc doesn't explain RandomForestClassifier.featureSubsetStrategy well
Add Integration tests for Secrets
SQL/Hive insertInto has unexpected resultsSPARK-13682
Finalize the public API for FileFormat- SPARK-22883
ML test for StructuredStreaming: spark.ml.feature, A-M
Add TaskContext.getLocalProperties in Python
Add Structured Streaming ForeachWriter for python
ClassCastException in "array_position" function
scala.MatchError in the "element_at" expression
Add local:// scheme support for the app jar in mesos cluster modeSPARK-24331
Add arrays_overlap / array_repeat / map_entries
Have RFormula include VectorSizeHint in pipeline
Bump master branch version to 2.4.0-SNAPSHOT
Implement EXCEPT ALL and INTERSECT ALL
Simplification of CachedKafkaConsumer.
Make sure all expressions support interpreted evaluation
Generate code that stores a float/double value in each column from ColumnarBatch when DataFrame.cache() is used
Add Power Iteration Clustering to spark.ml
spark.ml parity for sequential pattern mining - PrefixSpan
Generate Java code that gets an array in each column of CachedBatch when DataFrame.cache() is called
TextSocketMicroBatchReader no longer works with nc utility
Support ANSI-SQL compliant syntax for GROUPING SET
Add a new option `query` for JDBC sourcesSPARK-24374
SPIP: Support Barrier Execution Mode in Apache Spark
Upgrade apache/arrow to 0.10.0
Add Unsafe* copy methods to UnsafeWriter
UUID() should be stateful
Fix error recovering from the failure in a no-data batch