|
|
|
SPARK-42017
|
SPARK-41282
df["bad_key"] does not raise AnalysisException
|
Unassigned
|
Hyukjin Kwon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-42016
|
SPARK-41282
Type inconsistency of struct and map when accessing the nested column
|
Ruifeng Zheng
|
Hyukjin Kwon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41815
|
SPARK-41282
Column.isNull returns nan instead of None
|
Ruifeng Zheng
|
Hyukjin Kwon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41814
|
SPARK-41282
Column.eqNullSafe fails on NaN comparison
|
Ruifeng Zheng
|
Hyukjin Kwon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41784
|
SPARK-41282
Add missing `__rmod__`
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41783
|
SPARK-41282
Make column op support None
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41773
|
SPARK-41282
Window.partitionBy is not respected with row_number
|
Ruifeng Zheng
|
Hyukjin Kwon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41772
|
SPARK-41282
Enable pyspark.sql.connect.column.Column.withField doctest
|
Ruifeng Zheng
|
Hyukjin Kwon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41771
|
SPARK-41282
__getitem__ does not work with Column.isin
|
Ruifeng Zheng
|
Hyukjin Kwon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41770
|
SPARK-41282
eqNullSafe does not support None as its argument
|
Ruifeng Zheng
|
Hyukjin Kwon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41767
|
SPARK-41282
Implement `Column.{withField, dropFields}`
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41764
|
SPARK-41282
Make the internal string op name consistent with FunctionRegistry
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41762
|
SPARK-41282
Make `Column.__neg__` return the same column name as PySpark
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41761
|
SPARK-41282
Fix arithmetic ops: negate, pow
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41758
|
SPARK-41282
Support Window.rowsBetween
|
Ruifeng Zheng
|
Sandeep Singh
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
SPARK-41757
|
SPARK-41282
Compatibility of string representation in Column
|
Hyukjin Kwon
|
Sandeep Singh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41756
|
SPARK-41282
Support Column.getField, Column.getItem
|
Ruifeng Zheng
|
Sandeep Singh
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
SPARK-41751
|
SPARK-41282
Support Column.bitwiseAND,bitwiseOR,bitwiseXOR,eqNullSafe,isNotNull,isNull,isin
|
Ruifeng Zheng
|
Sandeep Singh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41740
|
SPARK-41282
Implement `Column.name`
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41731
|
SPARK-41282
Implement the column accessor
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41710
|
SPARK-41282
Implement `Column.between`
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41703
|
SPARK-41282
Combine NullType and typed_null
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41702
|
SPARK-41282
Add invalid ops
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41701
|
SPARK-41282
Make column op support `decimal`
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41688
|
SPARK-41282
Move Expressions to expressions.py
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41675
|
SPARK-41282
Make column op support `datetime`
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41673
|
SPARK-41282
Implement `Column.astype`
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41641
|
SPARK-41282
Implement `Column.over`
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41526
|
SPARK-41282
Implement `Column.isin`
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41506
|
SPARK-41282
Refactor LiteralExpression to support DataType
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41477
|
SPARK-41282
Correctly infer the datatype of literal integers
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41412
|
SPARK-41282
Implement `Cast`
|
Rui Wang
|
Rui Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41399
|
SPARK-41282
Refactor column related tests to test_connect_column
|
Rui Wang
|
Rui Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41351
|
SPARK-41282
Column does not support !=
|
Martin Grund
|
Martin Grund
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41335
|
SPARK-41282
Support IsNull and IsNotNull in Column
|
Rui Wang
|
Rui Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41334
|
SPARK-41282
move SortField from relations.proto to expressions.proto
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41332
|
SPARK-41282
Fix `nullOrdering` in `SortOrder`
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41329
|
SPARK-41282
Solve circular import between Column and _typing/functions
|
Hyukjin Kwon
|
Rui Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41328
|
SPARK-41282
Add logical and string API to Column
|
Rui Wang
|
Rui Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41319
|
SPARK-41282
when-otherwise support
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41292
|
SPARK-41282
Window-function support
|
Ruifeng Zheng
|
Martin Grund
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41278
|
SPARK-41282
Clean up unused QualifiedAttribute in Expression.proto
|
Rui Wang
|
Rui Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41268
|
SPARK-41282
Refactor "Column" for API Compatibility
|
Rui Wang
|
Rui Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41077
|
SPARK-41282
Rename `ColumnRef` to `Column` in Python client implementation
|
Rui Wang
|
Rui Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-40717
|
SPARK-41282
Support Column Alias in connect DSL
|
Rui Wang
|
Rui Wang
|
|
Resolved |
Fixed
|
|
|
|
|