Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-772

Continue cube job when hive query return empty resultset

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: v0.7.1
    • Fix Version/s: v1.1, v1.4.0
    • Component/s: Job Engine
    • Labels:
      None
    • Sprint:
      Sprint 42, Sprint 43, Sprint 44

      Description

      When there's no data in Hive table or in incremental query result set, the #3 "Step Name: Build Dimension Dictionary" will fail due to zero record.
      Error and block job is not ideal solution since many cases require empty segments to be created as placeholder for further refresh and merge, and continue to build with future data.

      Requirement:
      Add checkpoint about empty result set and continue entire cube build job.

        Attachments

          Activity

            People

            • Assignee:
              shaofengshi Shao Feng Shi
              Reporter:
              lukehan Luke Han
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: