[BEAM-1581] JSON source and sink

• Type: New Feature
• Status: Resolved
• Priority: P2
• Resolution: Won't Fix
• Fix Version/s: Not applicable
• Component/s: io-ideas
• Assignee: Unassigned
• Reporter: Aviem Zur
• Created: 01/Mar/17 10:00
• Updated: 24/Jul/20 20:17
• Resolved: 26/Feb/18 20:32

Description

JSON source and sink to read/write JSON files.
Similarly to XmlSource/XmlSink, these be a JsonSource/JonSink which are a FileBaseSource/FileBasedSink.
Consider using methods/code (or refactor these) found in AsJsons and ParseJsons

The PCollection of objects the user passes to the transform should be embedded in a valid JSON file
The most common pattern for this is a large object with an array member which holds all the data objects and other members for metadata.
Examples of public JSON APIs: https://www.sitepoint.com/10-example-json-files/
Another pattern used is a file which is simply a JSON array of objects.

Issue Links

• relates to: BEAM-2228 XmlIO could work with a PCollection