Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20933

Config Python Operator Use Managed Memory In Python DataStream

    XMLWordPrintableJSON

Details

    Description

      Now the way to set `Python DataStream Operator` to use managed memory is to set a hook in the `execute` method of `Python StreamExecutionEnvironment` to traverse the `StreamGraph` and set the `Python Operator` to use managed memory.
      But when the user’s job uses `from_data_stream` to convert the `DataStream` to a `Table`, the `TableEnvironment.execute` method is used at the end rather than `StreamExecutionEnvironment.execute`, so the `Python DataStream` related operators will not have `Managed Memory` set.

      Attachments

        Activity

          People

            hxbks2ks Huang Xingbo
            hxbks2ks Huang Xingbo
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: