Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1396

Bootstrap job via Hudi datasource hangs at the end of the spark-submit job

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.7.0
    • None

    Description

      Bootstrap job via Hudi datasource hangs at the end of the spark-submit job

       

      This issue is similar to https://issues.apache.org/jira/browse/HUDI-1230. Basically, HoodieWriteClient at https://github.com/apache/hudi/blob/release-0.6.0/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala#L255 will not be closed and as a result, the corresponding timeline server will not stop at the end. Therefore the job hangs and never exits.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              wenningd Wenning Ding
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: