Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20280 Support batch mode for Python DataStream API
  3. FLINK-21916

Allow OPERATOR and PYTHON ManagedMemoryUseCase to be used in the same operator

    XMLWordPrintableJSON

    Details

      Description

      Currently, the implementation of SimpleTransformationTranslator restricts that OPERATOR and PYTHON use case could not be used in the same operator. For batch mode of Python DataStream API:

      • OPERATOR use case will be added firstly in BatchExecutionUtils.applyBatchExecutionSettings for a keyed operator during translation
      • Then the PYTHON use case which is set in the transformation could not be added in SimpleTransformationTranslator as the streamNode.getManagedMemoryOperatorScopeUseCaseWeights() is not empty.

      We need to remove the restriction in SimpleTransformationTranslator  if there are no special reasons.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                dian.fu Dian Fu
                Reporter:
                dian.fu Dian Fu
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: