Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
Spark 1.5 release
Description
This is an umbrella ticket to track new expressions we are adding to SQL/DataFrame.
For each new expression, we should:
1. Add a new Expression implementation in org.apache.spark.sql.catalyst.expressions
2. If applicable, implement the code generated version (by implementing genCode).
3. Add comprehensive unit tests (for all the data types the expressions support).
4. If applicable, add a new function for DataFrame in org.apache.spark.sql.functions, and python/pyspark/sql/functions.py for Python.
For date/time functions, put them in expressions/datetime.scala, and create a DateTimeFunctionSuite.scala for testing.
Attachments
Issue Links
- duplicates
-
SPARK-9845 Add built-in UDF
-
- Resolved
-
- is blocked by
-
SPARK-7285 Audit missing Hive functions
-
- Resolved
-
- is related to
-
SPARK-7075 Project Tungsten (Spark 1.5 Phase 1)
-
- Resolved
-
-
SPARK-8829 Improve expression performance
-
- Resolved
-
- relates to
-
SPARK-9571 Improve expression function coverage
-
- Resolved
-