Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20280 Support batch mode for Python DataStream API
  3. FLINK-21916

Allow OPERATOR and PYTHON ManagedMemoryUseCase to be used in the same operator

    XMLWordPrintableJSON

Details

    Description

      Currently, the implementation of SimpleTransformationTranslator restricts that OPERATOR and PYTHON use case could not be used in the same operator. For batch mode of Python DataStream API:

      • OPERATOR use case will be added firstly in BatchExecutionUtils.applyBatchExecutionSettings for a keyed operator during translation
      • Then the PYTHON use case which is set in the transformation could not be added in SimpleTransformationTranslator as the streamNode.getManagedMemoryOperatorScopeUseCaseWeights() is not empty.

      We need to remove the restriction in SimpleTransformationTranslator  if there are no special reasons.

      Attachments

        Issue Links

          Activity

            People

              dian.fu Dian Fu
              dian.fu Dian Fu
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: