Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-1695

Deltastreamer HoodieIncrSource exception error messaging is incorrect

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      When you set your source_class as HoodieIncrSource and invoke deltastreamer without any checkpoint, it throws the following Exception:

       

      User class threw exception: java.lang.IllegalArgumentException: Missing begin instant for incremental pull. For reading from latest committed instant set hoodie.deltastreamer.source.hoodie.read_latest_on_midding_ckpt to true

       

      The error messaging is wrong and misleading, the correct parameter is:

      hoodie.deltastreamer.source.hoodieincr.read_latest_on_missing_ckpt
      

      Check out the correct parameter in this file

       

      The correct messaging should be:

      User class threw exception: java.lang.IllegalArgumentException: Missing begin instant for incremental pull. For reading from latest committed instant set hoodie.deltastreamer.source.hoodieincr.read_latest_on_missing_ckpt to true
      

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            vino Vinoth Govindarajan
            vino Vinoth Govindarajan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment