Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-746

Automatically Use Avro Serialization for Avro Objects

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.5.0
    • Spark Core
    • None

    Description

      All generated objects extend org.apache.avro.specific.SpecificRecordBase (or there may be a higher up class as well).

      Since Avro records aren't JavaSerializable by default people currently have to wrap their records. It would be good if we could use an implicit conversion to do this for them.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-34477 Kryo NPEs when serializing Avro GenericData objects (except GenericRecord)

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. AVRO-1502 Avro objects should implement Serializable

          • Major - Major loss of function.
          • Closed
          links to

          Pull request #7004 [Github] Pull Request #7004 (JDrit)

          Activity

            People

              jd Joseph Batchik
              patrick Patrick McFadin
              Votes:
              1 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: