Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26550

New datasource for benchmarking

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.0.0
    • Component/s: SQL
    • Labels:
      None

      Description

      Purpose of new datasource is materialisation of dataset without additional overhead associated with actions and converting row's values to other types. This can be used in benchmarking as well as in cases when need to materialise a dataset for side effects like in caching.

        Attachments

          Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. SPARK-26649 Noop Streaming Sink using DSV2

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #23471

            Activity

              People

              • Assignee:
                maxgekk Maxim Gekk
                Reporter:
                maxgekk Maxim Gekk
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: