Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-30244

When task using udf/udtf with jni, on k8s session the old TM will shut down and create new TM or the task will fail

    XMLWordPrintableJSON

Details

    Description

      We face a problem when we try to use flink on k8s to execute task with udf/udtf. When we finished or canceled a job and submit a same job, the old TM will be not reachable and restart. Why the TM have to be restart? In session mode, the TM should be reused by JM. Moreover, if we off restart strategy, this task will fail.

       

      First submit, the job will running:

       

      But, cancel it and submit the same:

      Internal server error, but in k8s the pod is running.

       

      Attachments

        1. image-2022-11-30-14-47-50-923.png
          653 kB
          AlexHu
        2. image-2022-11-30-15-00-06-710.png
          216 kB
          AlexHu
        3. image-2022-11-30-15-04-45-696.png
          328 kB
          AlexHu
        4. image-2022-11-30-15-05-29-120.png
          222 kB
          AlexHu

        Activity

          People

            Unassigned Unassigned
            AlexXXX AlexHu
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: