Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-833

Basic tasks (Mapper, Reducer and Combiner) for hadoopcompatibility

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Invalid
    • None
    • pre-apache
    • None

    Description

      Wrappers for basic tasks (Mapper, Reducer, Combiner), new interface for OutputCollectors and a testcase with a complete Hadoop WordCount. With these in place, along with ```HadoopDataSource``` and ```HadoopDataSink``` the ground is set to start working seriously on the hadoop abstraction layer (which by the way is my Google Summer of code project and starts officially today )

      Notice that in some cases there is code that might be generalised / refactored very soon.

      ---------------- Imported from GitHub ----------------
      Url: https://github.com/stratosphere/stratosphere/pull/833
      Created by: atsikiridis
      Labels: enhancement, java api, user satisfaction,
      Milestone: Release 0.6 (unplanned)
      Created at: Mon May 19 04:36:54 CEST 2014
      State: open

      Attachments

        Activity

          People

            Unassigned Unassigned
            github-import GitHub Import
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: