Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-6411

Verify and add transactions usability in Phoenix Spark connector

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • connectors-6.0.0
    • spark-connector
    • None

    Description

      Currently there is
      1) no way to disable/enable autocommit for the connections creating internally within the readers/writers and
      2) commits are getting called internally when batch size reaches which will not give control to application developer.
      3) No way to explicit commits (write on Dataset should call commit explicitly any way)
      Avoiding these may help to use transactions with in the connector.

      Attachments

        There are no Sub-Tasks for this issue.

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rajeshbabu Rajeshbabu Chintaguntla
            rajeshbabu Rajeshbabu Chintaguntla
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment