[SPARK-36930] Support ps.MultiIndex.dtypes

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: PySpark
• Assignee: dch nguyen
• Reporter: dch nguyen
• Created: 05/Oct/21 04:31
• Updated: 12/Dec/22 18:10
• Resolved: 06/Oct/21 06:36

Description

when MultiIndex.dtypes is supported, we can use:

>>> idx = pd.MultiIndex.from_arrays([[0, 1, 2, 3, 4, 5, 6, 7, 8], [1, 2, 3, 4, 5, 6, 7, 8, 9]], names=("zero", "one"))
>>> pdf = pd.DataFrame(
...     {"a": [1, 2, 3, 4, 5, 6, 7, 8, 9], "b": [4, 5, 6, 3, 2, 1, 0, 0, 0]},
...     index=idx,
... )
>>> psdf = ps.from_pandas(pdf)

>>> ps.DataFrame[psdf.index.dtypes, psdf.dtypes]
typing.Tuple[pyspark.pandas.typedef.typehints.IndexNameType, pyspark.pandas.typedef.typehints.IndexNameType, pyspark.pandas.typedef.typehints.NameType, pyspark.pandas.typedef.typehints.NameType]

Issue Links

• links to: [Github] Pull Request #34179 (dchvn)
• links to: [Github] Pull Request #34206 (dchvn)