Uploaded image for project: 'Spark'

Spark

Components

Component Lead Description
Block Manager Block storage layer in Spark core
Build Build system
Deploy
Documentation Anything related to Spark docs
DStreams Spark DStreams API
EC2 EC2 scripts
Examples
GraphX Graph processing package
Input/Output
Java API
Mesos
ML Features under the spark.ml package
MLlib Machine learning library
Optimizer
Project Infra
PySpark Spark Python API
Scheduler DAG schedulers or Task Schedulers in Spark core
Shuffle
Spark Core
Spark Shell Spark interactive shell
Spark Submit Spark's submission gateway and launcher library
SparkR R language support
SQL Spark SQL module
Structured Streaming Spark Streaming with DataFrames, Datasets and SQL
Tests Unit tests in various components
Web UI
Windows
YARN