Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-33638

Full support of V2 table creation in Structured Streaming writer path

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.2.0
    • None
    • Structured Streaming
    • None

    Description

      Currently, we want to add support of creating if not exists in DataStreamWriter.toTable API. Since the file format in streaming doesn't support DSv2 for now, the current implementation mainly focuses on V1 support. We need more work to do for the full support of V2 table creation.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-33577 Add support for V1Table in stream writer table API

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              XuanYuan Yuanjian Li
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: