Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2736

Create PySpark RDD from Apache Avro File

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0
    • PySpark
    • None

    Description

      There is a partially working example Avro Converter at this pull request: https://github.com/apache/spark/pull/1536

      It does not fully implement all types in the Avro format and could be cleaned up a little bit.

      Attachments

        Activity

          People

            kzhang Kan Zhang
            eric.garcia Eric Garcia
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 4h
                4h
                Remaining:
                Remaining Estimate - 4h
                4h
                Logged:
                Time Spent - Not Specified
                Not Specified