Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-38484

Move usage logging instrumentation util functions from pandas module to pyspark.util module

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.2.1
    • 3.3.0
    • PySpark
    • None

    Description

      It will be helpful to attach the usage logger to other modules (e.g. sql) besides Pandas but other modules should not depend on Pandas modules to use the instrumentation utils (e.g. _wrap_function, _wrap_property ...). So we need to move usage logging instrumentation util functions from Pandas module to pyspark.util module.

      Attachments

        Activity

          People

            heyihong Yihong He
            heyihong Yihong He
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: