Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-3900

Introduce Euphoria Java 8 DSL

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0
    • Component/s: dsl-euphoria
    • Labels:
      None

      Description

      This is the umbrella issue for integrating Euphoria API into Beam.

        Attachments

          Issue Links

          1.
          Euphoria: Initial import from github Sub-task Closed David Morávek

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          2.
          Euphoria: Integration with gradle build system Sub-task Closed David Morávek

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          3.
          Join operator translator Sub-task Closed Vaclav Plajt  
          4.
          Migration of ReduceByKey test suite Sub-task Closed Vaclav Plajt  
          5.
          Flipping tests - some tests in Euphoria operator test suit are failing randomly Sub-task Closed Vaclav Plajt  
          6.
          Add Euphoria Java 8 DSL to "Conbribute > Technical References > Ongoing Projects" Sub-task Closed Marek Simunek

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 40m
          7.
          Update Operator Testkit Sub-task Closed Vaclav Plajt  
          8.
          General Cleanup Sub-task Closed Vaclav Plajt  
          9.
          Add type hint information Sub-task Closed Marek Simunek  
          10.
          Improve windowing API Sub-task Closed Vaclav Plajt  
          11.
          Translation Euphoria Accumulators to Beam Metrics Sub-task Closed Marek Simunek  
          12.
          Enable tests in `OperatorsTestSuite` where possible Sub-task Closed Vaclav Plajt  
          13.
          Remove 'Executor' concept Sub-task Closed Vaclav Plajt  
          14.
          Add posibility to define composite PTransform throught Euphoria API Sub-task Closed Vaclav Plajt  
          15.
          Extend euphoria API to allow registaration of Beam Coders Sub-task Closed Vaclav Plajt  
          16.
          Flipping tests Sub-task Closed Vaclav Plajt  
          17.
          Better Kryo integration Sub-task Closed Vaclav Plajt  
          18.
          Allow all operators to carry type descriptors of its element Sub-task Closed Vaclav Plajt  
          19.
          Use type informations about output, key and values from operators to set coders Sub-task Closed Vaclav Plajt  
          20.
          Use type informations about output, key and values from operators to set coders Sub-task Closed Vaclav Plajt  
          21.
          Replace Euphoria's Pair with Beam's KV Sub-task Closed Vaclav Plajt  
          22.
          Testsuite do not run all tests it should Sub-task Closed Vaclav Plajt  
          23.
          Write Euphoria in Beam documentation Sub-task Closed Vaclav Plajt

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2.5h
          24.
          Fix failing `ReduceWindow` test Sub-task Closed Vaclav Plajt  
          25.
          Enable FindBugs Sub-task Closed Vaclav Plajt  
          26.
          Testsuite `BroadcastHashJoin` test are not enabled Sub-task Closed Vaclav Plajt  
          27.
          Use chunked Kryo encoding instead of our own chunking Sub-task Closed Vaclav Plajt  
          28.
          Add support for `TopPerKey` operator Sub-task Closed Vaclav Plajt  
          29.
          Use chunked Kryo encoding instead of our own chunking Sub-task Closed Vaclav Plajt  
          30.
          Clean TODOs and unused classes. Sub-task Closed Vaclav Plajt  
          31.
          Missing windowing error message is not undestandable to Euphoria user Sub-task Closed Vaclav Plajt

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          32.
          Euphoria to Beam translators should set coders to output `PCollections' Sub-task Closed Vaclav Plajt  
          33.
          Add support for accumulatrors to `SingleValueCollector` Sub-task Closed Vaclav Plajt  
          34.
          `ListDataSource` should not enforce data items to be serializable Sub-task Closed Vaclav Plajt  
          35.
          Support ReduceByKey - sorted values Sub-task Open Vaclav Plajt  
          36.
          Joins should support more than one output element from user joining UDF Sub-task Closed Vaclav Plajt  
          37.
          SingleJvmAccumulatorProvider fix Sub-task Closed Marek Simunek  
          38.
          Add option to run testkit tests using Spark runner on local cluster Sub-task Closed Vaclav Plajt  
          39.
          Kryo NO-OP registrars can swap IDs between JVMs Sub-task Closed Vaclav Plajt  
          40.
          Separate Kryo to module of its own Sub-task Closed Vaclav Plajt  
          41.
          Refactor `EuphoriaCoderProvider` to `KryoCoderProvider` Sub-task Closed Vaclav Plajt  
          42.
          Euphoria: Remove Dataset abstraction Sub-task Closed David Morávek

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 10m
          43.
          Operator translation based on operator name Sub-task Closed Marek Simunek

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 20m
          44.
          Refactor traslator providers Sub-task Closed Vaclav Plajt

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 10m
          45.
          Remove unnecesarry Kryo dependecny from euphoria Sub-task Resolved Vaclav Plajt

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 10m

            Activity

              People

              • Assignee:
                dmvk David Morávek
                Reporter:
                dmvk David Morávek
              • Votes:
                1 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 18.5h
                  18.5h