[FLINK-377] Create a general purpose framework for language bindings

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: pre-apache
• Labels: github-import
• Assignee: Chesnay Schepler
• Reporter: GitHub Import
• Created: 09/Jun/14 12:11
• Updated: 21/Apr/15 14:12
• Resolved: 21/Apr/15 14:00

Description

A general purpose API to run operators with arbitrary binaries.
This will allow to run Stratosphere programs written in Python, JavaScript, Ruby, Go or whatever you like.

We suggest using Google Protocol Buffers for data serialization. This is the list of languages that currently support ProtoBuf: https://code.google.com/p/protobuf/wiki/ThirdPartyAddOns
Very early prototype with python: https://github.com/rmetzger/scratch/tree/learn-protobuf (basically testing protobuf)
For Ruby: https://github.com/infochimps-labs/wukong

Two new students working at Stratosphere (@skunert and @filiphaase) are working on this.
The reference binding language will be for Python, but other bindings are very welcome.
The best name for this so far is "stratosphere-lang-bindings".

I created this issue to track the progress (and give everybody a chance to comment on this)

---------------- Imported from GitHub ----------------
Url: https://github.com/stratosphere/stratosphere/issues/377
Created by: rmetzger
Labels: enhancement,
Assignee: filiphaase
Created at: Tue Jan 07 19:47:20 CET 2014
State: open