Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20933

Config Python Operator Use Managed Memory In Python DataStream

    XMLWordPrintableJSON

    Details

      Description

      Now the way to set `Python DataStream Operator` to use managed memory is to set a hook in the `execute` method of `Python StreamExecutionEnvironment` to traverse the `StreamGraph` and set the `Python Operator` to use managed memory.
      But when the user’s job uses `from_data_stream` to convert the `DataStream` to a `Table`, the `TableEnvironment.execute` method is used at the end rather than `StreamExecutionEnvironment.execute`, so the `Python DataStream` related operators will not have `Managed Memory` set.

        Attachments

          Activity

            People

            • Assignee:
              hxbks2ks Huang Xingbo
              Reporter:
              hxbks2ks Huang Xingbo
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: