Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-46930

Add support for a custom prefix for Union type fields in Avro when enableStableIdentifiersForUnionType is enabled

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 4.0.0
    • 4.0.0
    • SQL

    Description

      enableStableIdentifiersForUnionType allows to enable stable identifiers in Avro. We need to add another config to allow configuring the custom prefix used in stable identifiers. Currently the value is member_, e.g. member_int, member_string, but we should be able to change to any value or even leave empty.

      Attachments

        Issue Links

          Activity

            People

              ivan.sadikov Ivan Sadikov
              ivan.sadikov Ivan Sadikov
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: