Description
This is an umbrella ticket to track new expressions we are adding to SQL/DataFrame in 1.6+.
For each new expression, we should:
1. Add a new Expression implementation in org.apache.spark.sql.catalyst.expressions
2. If applicable, implement the code generated version (by implementing genCode).
3. Add comprehensive unit tests (for all the data types the expressions support).
4. If applicable, add a new function for DataFrame in org.apache.spark.sql.functions, and python/pyspark/sql/functions.py for Python.
Attachments
Issue Links
- is related to
-
SPARK-8159 Improve expression function coverage (Spark 1.5)
-
- Resolved
-
1.
|
misc function: hash |
|
Resolved | Wenchen Fan |
2.
|
string function: find_in_set |
|
Resolved | Tarek Auel |
3.
|
string function: translate |
|
Resolved | zhichao-li |
4.
|
Implement json_tuple |
|
Resolved | Nathan Howell |
5.
|
datetime function: to_unix_timestamp |
|
Resolved | Adrian Wang |
6.
|
conditional function: field |
|
Resolved | Unassigned |