Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-2849

Improve job/stage description in spark UI for hudi write

    XMLWordPrintableJSON

Details

    Description

      The following image shows upsert process using deltastreamer. The job description is unclear and sometimes misleading. E.g., there are two jobs with name 'isEmpty' and one of them actually can be removed. The job 8 does the partition and write task, but it is named as 'Getting small files from partitions'.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              yuweixiao Yuwei Xiao
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: