[SPARK-37472] Missing functionality in spark.pandas

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.2.0
• Component/s: PySpark
• Assignee: Unassigned
• Reporter: Rens Jochemsen
• Created: 26/Nov/21 09:56
• Updated: 30/Nov/21 04:21

Description

dear,

 

I am missing the functionality to include local variables in the query method.

```

seg = 'A'

psdf.query("segment == @seg")

 

``` 

 

or 

seg = ['A', 'B']

psdf.query("segment == @seg")

```

 

Furthermore I was wondering whether date-offset functionalty as pd.offsets.MonthEnd will be added to future versions.