Description
In SPARK-43270, we add a support for the autocomplete suggest for df.| , which also suggest column_name for dataframe.
However, we found out later that some dataframe can have column which has illegal variable name (e.g: name?1, name 1, 2name etc.) These variable name should be filtered out and this will be consistent with pandas behavior now