Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.4.0
    • 2.4.0
    • SQL
    • None

    Description

      With code changes in https://github.com/apache/spark/pull/21847 , Spark can write out data as per user provided output schema.

      To make it more robust and user friendly, we should validate the Avro schema before tasks launched.

      Also we should support output logical decimal type as BYTES (By default we output as FIXED)

      Attachments

        Activity

          People

            Gengliang.Wang Gengliang Wang
            Gengliang.Wang Gengliang Wang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: