Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-3900

Introduce Euphoria Java 8 DSL

Details

    • New Feature
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.9.0
    • dsl-euphoria
    • None

    Description

      This is the umbrella issue for integrating Euphoria API into Beam.

      Attachments

        Issue Links

          1.
          Euphoria: Initial import from github Sub-task Resolved David Morávek

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          2.
          Euphoria: Integration with gradle build system Sub-task Resolved David Morávek

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          3.
          Join operator translator Sub-task Resolved Vaclav Plajt  
          4.
          Migration of ReduceByKey test suite Sub-task Resolved Vaclav Plajt  
          5.
          Flipping tests - some tests in Euphoria operator test suit are failing randomly Sub-task Resolved Vaclav Plajt  
          6.
          Add Euphoria Java 8 DSL to "Conbribute > Technical References > Ongoing Projects" Sub-task Resolved Marek Simunek

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 40m
          7.
          Update Operator Testkit Sub-task Resolved Vaclav Plajt  
          8.
          General Cleanup Sub-task Resolved Vaclav Plajt  
          9.
          Add type hint information Sub-task Resolved Marek Simunek  
          10.
          Improve windowing API Sub-task Resolved Vaclav Plajt  
          11.
          Translation Euphoria Accumulators to Beam Metrics Sub-task Resolved Marek Simunek  
          12.
          Enable tests in `OperatorsTestSuite` where possible Sub-task Resolved Vaclav Plajt  
          13.
          Remove 'Executor' concept Sub-task Resolved Vaclav Plajt  
          14.
          Add posibility to define composite PTransform throught Euphoria API Sub-task Resolved Vaclav Plajt  
          15.
          Extend euphoria API to allow registaration of Beam Coders Sub-task Resolved Vaclav Plajt  
          16.
          Flipping tests Sub-task Resolved Vaclav Plajt  
          17.
          Better Kryo integration Sub-task Resolved Vaclav Plajt  
          18.
          Allow all operators to carry type descriptors of its element Sub-task Resolved Vaclav Plajt  
          19.
          Use type informations about output, key and values from operators to set coders Sub-task Resolved Vaclav Plajt  
          20.
          Use type informations about output, key and values from operators to set coders Sub-task Resolved Vaclav Plajt  
          21.
          Replace Euphoria's Pair with Beam's KV Sub-task Resolved Vaclav Plajt  
          22.
          Testsuite do not run all tests it should Sub-task Resolved Vaclav Plajt  
          23.
          Write Euphoria in Beam documentation Sub-task Resolved Vaclav Plajt

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2.5h
          24.
          Fix failing `ReduceWindow` test Sub-task Resolved Vaclav Plajt  
          25.
          Enable FindBugs Sub-task Resolved Vaclav Plajt  
          26.
          Testsuite `BroadcastHashJoin` test are not enabled Sub-task Resolved Vaclav Plajt  
          27.
          Use chunked Kryo encoding instead of our own chunking Sub-task Resolved Vaclav Plajt  
          28.
          Add support for `TopPerKey` operator Sub-task Resolved Vaclav Plajt  
          29.
          Use chunked Kryo encoding instead of our own chunking Sub-task Resolved Vaclav Plajt  
          30.
          Clean TODOs and unused classes. Sub-task Resolved Vaclav Plajt  
          31.
          Missing windowing error message is not undestandable to Euphoria user Sub-task Resolved Vaclav Plajt

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          32.
          Euphoria to Beam translators should set coders to output `PCollections' Sub-task Resolved Vaclav Plajt  
          33.
          Add support for accumulatrors to `SingleValueCollector` Sub-task Resolved Vaclav Plajt  
          34.
          `ListDataSource` should not enforce data items to be serializable Sub-task Resolved Vaclav Plajt  
          35.
          Support ReduceByKey - sorted values Sub-task Open Unassigned  
          36.
          Joins should support more than one output element from user joining UDF Sub-task Resolved Vaclav Plajt  
          37.
          SingleJvmAccumulatorProvider fix Sub-task Resolved Marek Simunek  
          38.
          Add option to run testkit tests using Spark runner on local cluster Sub-task Resolved Vaclav Plajt  
          39.
          Kryo NO-OP registrars can swap IDs between JVMs Sub-task Resolved Vaclav Plajt  
          40.
          Separate Kryo to module of its own Sub-task Resolved Vaclav Plajt  
          41.
          Refactor `EuphoriaCoderProvider` to `KryoCoderProvider` Sub-task Resolved Vaclav Plajt  
          42.
          Euphoria: Remove Dataset abstraction Sub-task Resolved David Morávek

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 10m
          43.
          Operator translation based on operator name Sub-task Resolved Marek Simunek

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 20m
          44.
          Refactor traslator providers Sub-task Resolved Vaclav Plajt

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 10m
          45.
          Remove unnecesarry Kryo dependecny from euphoria Sub-task Resolved Vaclav Plajt

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 10m

          Activity

            People

              dmvk David Morávek
              dmvk David Morávek
              Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 18.5h
                  18.5h