Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20136

Add num files and metadata operation timing to scan metrics

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.1.0
    • 2.2.0
    • SQL
    • None

    Description

      We currently do not include explicitly metadata operation timing and number of files in data source metrics. Those would be useful to include for performance profiling.

      Attachments

        Activity

          People

            rxin Reynold Xin
            rxin Reynold Xin
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: