Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-1901

Create sample operator for Dataset

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      In order to be able to implement Stochastic Gradient Descent and a number of other machine learning algorithms we need to have a way to take a random sample from a Dataset.

      We need to be able to sample with or without replacement from the Dataset, choose the relative or exact size of the sample, set a seed for reproducibility, and support sampling within iterations.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-1807 Stochastic gradient descent optimizer for ML library

          • Major - Major loss of function.
          • Closed
          contains

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-1742 Sample data points for MultipleLinearRegression to support proper SGD

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-2533 Gap based random sample optimization

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-2535 Fixed size sample algorithm optimization

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-3783 Support weighted random sampling with reservoir

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is related to

          New Feature - A new feature of the product, which has yet to be developed. FLINK-2549 Add topK operator for DataSet

          • Not a Priority -
          • Reopened
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-2396 Review the datasets of dynamic path and static path in iteration.

          • Not a Priority -
          • Open

          Activity

            People

              chengxiang li Chengxiang Li
              tvas Theodore Vasiloudis
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: