Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-7286

Flink Dashboard fails to display bytes/records received by sources / emitted by sinks

    XMLWordPrintableJSON

Details

    Description

      It appears Flink can't measure the number of bytes read or records produced by a source (e.g. Kafka source). This is particularly problematic for simple jobs where the job pipeline is chained, and in which there are no measurements between operators. Thus, in the UI it appears that the job is not consuming any data.

      Attachments

        Issue Links

          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. FLINK-9050 Expose operator IO counter metrics

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-10740 FLIP-27: Refactor Source Interface

          • Not a Priority -
          • Open
          is related to

          New Feature - A new feature of the product, which has yet to be developed. FLINK-11576 FLIP-33: Standardize connector metrics

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue FLINK-10707 Improve Cluster Overview in Flink Dashboard

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. FLINK-33681 Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              elevy Elias Levy
              Votes:
              9 Vote for this issue
              Watchers:
              25 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: